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FOREWORD 


Thla  rap or t  |g  the  first  volume  of  a  two-volume  final  report  prepared 
by  the  School  of  Electrical  Engineering*  Purdue  University*  under  USAF 
Contract  No*  AF  3316161  -  6690*  Project  No*  8229*  Teak  No*  82181.  The 
contract  le  administered  under  the  direction  of  the  Flight  Control  Labora¬ 
tory*  Wright  Air  Development  Division*  Mrlght-Petteraon  Air  Force  Base* 
Dayton,  P**1©,  by  Lt.  P.  C.  Oragory.  the  Initiator  of  the  study. 

This  volume  preaenta  the  development  and  analysis  of  a  particular 
class  of  adaptive  controls  under  the  assumption  of  the  sval lability  of 
Identification  Information.  The  second  volume  deals  with  the  limits  on 
the  Identification  time  for  linear  systems  for  a  number  of  Identification 
techniques. 

For  the  past  year  Purdue  University  has  had  portlal  support  by  the 
Air  Force  In  a  rather  brued  study  of  adaptive  control  systems.  The 
study  was  Initiated  some  two  end  one  hell  years  ego  and  la  still  con¬ 
fine  ng.  During  this  general  research  effort  a  number  of  critical  arse a 
In  tha  theory  of  adoptive  control  have  been  uncovered.  In  several  of 
these  areas  specific  research  objectives  ware  set  end  results  obtained* 
while  In  other  arses  work  remains  to  bo  dons. 

Ono  of  those  critical  areas  and  that  covered  by  this  report  le 
the  unnecessary  restriction  of  the  adjustment  procedure  to  Incremental 
or  continuous  adjustment  of  physical  parameters.  This  Is  the  parameter 
sdjuitaient  solution  to  the  control  eigne!  modification  problem.  The 
more  general  procedure*  discussed  here*  Ilea  In  control  signal  synthesis. 
In  which  e  new  signal  Is  generated  with  which  to  drive  the  plant  so  as 
to  achieve  optimum  response* 

Thla  taobnloal  report  bas  baan  reviewed  and  Is  approved* 

«.  a.  atom,  jr. 

Colossi*  USAF 

Chief.  Flight  Control  Division 
AF  Flight  Dynamics  laboratory 
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A  m-sond  -rltlcal  area  that  has  bsen  under  Invast  (get  Ion  at  Purdus 

U  *h *  ,d*nH  C*Hon  prob,*"‘*  1«  Volwa#  2  of  this  final  report  cooper 

Underfeub  report  on  fhalr  study  of  the  speed  and  accuracy  of  various 

Identification  achesws  which  do  not  repulr.  e  priori  Information  concern¬ 
ing  the  plant, 

independent  of  Air  Force  aupport,  Schlewt  he.  raportad  on  his  analysis 
of  SNif f l-disienafonal  odaptlva  eyotema  which  measure  not  the  impulse  raaponaa 
of  the  plant  but  only  certain  Important  aspects  of  that  raaponaa  and 
Evelafgh  he.  comp. red  Increment.!  va.  .Inusoldal  perturbation  In  multi¬ 
dimensional  adaptive  «y.tem.  for  speed  of  response  end  hunting  loss.  Tou 

*nd  hU  e°-*0rh#r*'  '““P*  Uwla,  hov.  besn  actively  studying  th* 
digital  adoptive  problem  and  achlaved  very  encouraging  result*, 

»«rk  la  continuing  now  on  new,  feet  Identification  schemes  end 
theoretical  enely.ee  of  Idaatif Ictlon  with  •  priori  Information.  As 
"•»»  «  I«  the  newer  and  r.l.tlvo.y  unexplored  ores  of  ey.tem.  which  a,. 

Mbit  learning.  These  retire  memory  capacity  and  eztended  logic  In  th a 
adapt) va  loop  and  th*  capacity  for  modifying  th*  control  law  In  accord 
Mth  generalized  performance  criteria. 
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AUSTPACT 

A  n«w  class  of  control  systems  tsrr.ed  predictive  adaptive)  controls 

and  the  psrtwrmo.iww  chm-»cT»»risrics  art  invastlgatsd  analyti¬ 
cally  and  experimental ly. 

The  concepts  of  signal  predict  ion.  Interval  control,  and  synthesis 
of  tha  control  variable  by  a  sun  of  ortlionormsl  polynomials  In  t  ara 
Introduced  and  developed  In  relation  to  adaptive  control.  A  modified 
leaet  squares  Integral  Index  of  performance  la  formulated  and  uaed  as 
the  crl ♦--l<*«  for  r-'stam  optimization.  Control  of  dynamic  processas  Is 
subdivided  Into  Intervals  of  s  specified  length  T  and  prediction  is  usod 
to  obtain  sat  law  tea  of  future  values  of  system  error. 

Minimization  of  the  Index  of  juerf oi-Menes  leads  to  a  family  of  control 
Isms  which  specify  the  structure  of  ths  cor oiler.  Tbs  resulting  control 
conf I  Duration  Is  optimum  In  a  specif tc  mathematical  sense  end  la  readily 
realizable  with  available  physical  cosponents.  Tha  adaptive  capability 
la  achieved  through  time-varying  gains  which  are  specific  function*  of 
tha  unit  Impulse  response  of  tha  dynamic  -process  being  controlled. 

Predictor  design  la  presented  In  terms  of  tha  classical  Wlener~l.ee 
theory,  and  a  relationship  for  control  Interval  length  as  a  function  of 
prediction  accuracy  la  developed. 

Preliminary  design  of  tha  controller  ia  considered  from  tha  viewpoints 
of  relative  weighting  of  eystsm  error  and  control  effort,  control  Interval 
length  T,  and  the  number  of  terms  needed  In  the  orthonormef  polynomial  sum 
approximation  of  the  control  variable,  A  method  of  obtaining  an  engineer¬ 
ing  estimate  of  tha  latter  quantity  Is  developed  and  Illustrated  by  three 
•wimples,  two  of  which  ara  Investigated  experimental ly. 
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Two  appl  leaf  ion«  nt  prttdicvr/e  adaptive  control  <wrw  Invent  I  gated  on 
an  Analog  cnmpuf er.  The  tm  dy»«»fc  nroceaacs  used  are  c  f  I  rat-order  proc- 

<*■«  whose  parameter  vsrtfev  rvc”  a  range  of  ten  fo  one  and  «  «.tfcond-order 

« 

process  whoa*  parameter  var lea  In  such  a  manner  that  Che  process  ta  tin- 
atahle  at  one  extreme  and  heavily  damped  «t  the  other.  Yhe  rr suite  of 
throe  basic  experiments  which  evaluate  the  ste*dy-»tatr  adaptability, 
transient  response,  and  statistical  signal  response  of  the  two  systems 
are  reported.  It  Is  found  that  all  three  eapecta  of  aystaM  performance 
Improve  with  decreasing  control  Interval  length,  but  that  the  minimum 
value  of  the  imm*'***  length  srfilc'i  can  be  used  Is  limited  by  the  accuracy 
of  tha  t [iwa-veryi.'ifl  gain  and  controller  circuitry.  Improved  performance 
which  tin  be  achieved  by  Increasing  tha  reitflve  weighting  of  syatsm 
error  end  control  effort,.  Is  limited  by  saturation  consideration*. 
Theoretical  results  that  ~elnt  to  the  need  for  keeping  the  control  Jn> 
tsrvaJ. length  abort  to  preearve  stability,  prediction  accuracy,  and  foes 
of  con tr o'  due  to  process  parameter  drift  are  substantiated  by  the  experi¬ 
mental  results,  for  the  two  eya terns  investigated  It  la  found  that  satis¬ 
factory  control  Is  achieved  If  tha  Interval  length  la  chosen  so  that 
process  parameter  drift  is  no  wore  then  49  per  control  Interval,  A 
figure  of  99  was  estimated  originally, 

A  one- term  approx I mo tier  of  the  control  variable  la  used  to  control 
tha  first-order  process  and  I  a  found  to  give  sat  I (factory  performance* 

A  four-term  approximation  Is  found  to  give  adequate  control  of  tha  second- 
order  process  whereas  tha  thrae-tenm  approximation  does  net.  These  results 
bear  out  tha  predlctlonn  wad*  In  the  theoretical  analyses. 
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CHAPTER  1 
INTHOOUCTIO* 

The  need  for  procloo  control  of  dynamic  processes  ho*  stimulated 
Interest  In  tho  development  of  thoorloa  and  mot hod a  for  optimizing 
control  systems.  Hazon  [ij  In  1034  and  Hall  in  1943  initiated  what 
la  today  tanned  tho  conventional  design  of  feedback  control  syatume. 

Thalr  work  waa  followed  by  that  of  Wiener  In  1948  which  forma  the 
foundation  of  claealcal  analytical  deaign  theory  of  optimum  control*. 

A*  originally  formulated,  Wiener"  a  method*  are  applicable  only  to  linear, 
time-invariant  dynamic  processes  which  are  to  be  optimized  wl th  respect 
to  o  laast-equarsa  figure  of  morlt  or  performance  index.  Usually,  the 
optimization  amounts  to  specifying  a  compensation  schema  which  maxi¬ 
mizes,  minimizes,  or  glvoa  a  particular  value  to  tho  specified  Index  of 
performance.  Boot  mi  [4],  In  1992,  extended  Wiener* a  work  further  by 
using  enaomble  average*  Inetoed  of  time  everagaa.  Hla  results  permit 
the  optimization  of  linear,  tlma-varytng  dynamic  processes  subjected  to 
stochastic  signals  possessing  either  time-invariant  or  time-varying 
statistics.  This  la  in  contrast  to  Newton'  a  (Yj  methods  which  are  re¬ 
stricted  to  flaw- 1  aver  I  ant  dynamic  processes  with  deterministic  eiwl/or 
stochastic  signals  having  time- invar! ant  statistics, 

Mathews  and  Staag  [flj,  and  Boo ton  [?],  In  1993,  studied  the  response 
characteristics  of  terminal,  or  final-value  controls.  Thalr  work  pre¬ 
sent  a  the  analytical  design  of  a  class  of  non-linear  systems  put  la 
restrict ive  because  only  on#  point  of  the  response,  th*  terminal  point. 

Is  considered. 

1.1  Adapt  I  vs  Controls 

Mora  recently,  considerable  Interest  has  centered  about  a  new  class 
of  control  ays tame  termed  adeptly*  fs]  or  self-adaptive  controls  [9]. 

Maanaorlpt  released,  by  the  anchors  1  Bsbruazy  1951  for  pnUloatioo  as  an 
ASD  technical  2* port. 
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irn  sf  this  J tndi cbtvo  i»  8  lengthy  »«»« «ogr*phy  on  the 

subject  compiled  by  Stromer  fin]. 

An  tdaptlve  control  system  la  defined  tier*  as  a  control  system  which 
I®  capable  of  monitoring  Ita  own  performance  with  reapect  to  a  given 
Index  of  performance  or  optimum  condition  and  modifying  lta  behavior  by 
cioaad-loop  action  In  auch  a  manner  ea  to  optimize  the  Index  of  perform- 
once  or  approach  the  optimum  condition.  The  neceaelty  of  auch  systems  la 
apparent  In  the  control  of  dynam.'r  proceaeea  whose  operating  character¬ 
istics  vary  over  a  wide  range  during  normal  operation.  Far  examp  is.  auch 
dynamic  processes  as  hlgh-upeed  aircraft,  apace  vehicles,  and  chemical 
plants  experience  wide  variations  Is  their  environments  throughout  their 
course  of  operation.  This  places  heavy  demands  on  their  central  systems 
which  cannot  be  owl  in  a  completely  satisfactory  manner  by  conventional 
controllers.  The  reason  for  this  Is  clear  dee  oss  recalls  that  conven¬ 
tional  designs  are  based  on  satisfying  one  or  mors  design  criteria 
assuming  the  dynamic  process  Is  linear  sad  time-invariant  throughout  Its 
performance  envelops.  Ar  esmapls  Is  point  hers  la  the  minimisation  of 
the  Integra I -square-error  of  e  positional  control  system  for  a  reap  In¬ 
put  subject  to  a  constraint  on  the  msan-sdusrs  noise  power  In  the  output. 
At  bast,  this  problem  could  be  treated  by  conventional  methods  only  If  a 
complete  knowledge  of  the  tlme-ln variant  or  time- varying  character  of 

i 

both  the  fixed  element*  and  the  signals  Is  evellsblc  a  priori.  Unfortu¬ 
nately,  the  dynamic  processes  mentioned  above  ere  celled  upon  to  function 
in  environments  which  era  at  mast  only  partially  known  s  priori .  ttencs, 
the  information  noedod  to  effect  a  conventional  design  for  such  a  process 
Is  net  aval  fable  until  the  process  has  begun  functioning.  Aa  a  reavH, 
the  use  of  control  aystmas,  capable  of  monl taring,  evaluating,  and 


modifying  their  performance  to  meet  the  demands  of  control  dictated  by  a 
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ehcopiej;  is  umiutatory  f nr  such  dynamic  proeesseu.  Moreover*. 

j  '•*  •  result  of  ctwaiv/i f»u  environment,  the  goaf  or  ta*k  of  the  control 
system  may  change  and  Hue  weighting  a*  system  error  way  became  c*r>ro  or 
lass  Important. 

In  atHMry,  cxamplt  situations  w hera  the  uwt  of  adoptive  control  la 
warranted  may  fit*  classified  broadly  as  follows* 

1.  Tfw  ehnrec tar list Ion  of  th*  dynamic  process  la  an  unknown  funcfitt*! 
of  the  environment  to  which  tha  dynamic  process  la  subjected, 

2.  Tha  goal  or  t«ak  of  tha  control  ayatam  changes  with  environment. 
For  example,  tha  task  of  a  chamical  process  control lar  during 
normal  ooaratlon  la  to  maintain  such  process  oerametere  a«t 
temperatures,  pressures,  flow  rataa.  and  prcduct  qualities  at 
tnalr  daairad  values.  On  tha  athar  hand,  during  atartup  tha 
control lar  must  change  the  process  variables  aa  rapidly  m 
poaalbla  to  achieve  tha  desired  steady-state. 

I 

J.  Tha  Indax  of  performance  uaad  re  eveSusfe  tha  parformanc<  of 

tha  dynamic  procaa*  changaa  with  tlma.  For  example,  small  devi- 
atlona  from  tha  dashed  trajectory  of  a  ballistic  ml  sail*  must 
ba  swighted  more  heavily  during  tha  tormina  I  phase  of  the  trajac¬ 
tory  than  thay  jra  during  tha  aarllar  phases  of  tha  flight  path. 
1.2  Statamant  of  tha  Adapt  I ve  Control  Problem 

Tha  daflnltlon  of  an  adapt  1 *e  control  system  lap  lias  three  functions 
vdilch  tha  »y*ltfl  must  ba  capabta  of  performing  £ti]  ; 

1.  Provide  Information  about  tha  charactar  of  the  dynamic  process, 

I  .a.,  I  dan  1 1  fy  tha  dynenlc  process, 

2.  Evaluate  tha  performance  of  tha  dynamic  proeaao  wlfh  respect  to 
an  Indax  of  performance  and  metre  a  decision  on  how  to  achieve 
optimum  performance. 


>.  Initiate  atott *  fleet  tor,  of  sigr-ala  and/or  dynamic  process  pdre- 
raeJars  IU*  order  to  rcn !  lie  optimum  performance. 

Siencw.  the  gtjner-ai  problem  of  adaptive  control  divides  l«y)ctl'3y 
Intci  three  fefflni'c  problems:!  I dent if ictof Ion.  decision,  and  modi ficaHnsn, 

Each  of  th at*  basic  problems  3n  itself  represents  «  complete  are*  of 
rtwerefr.  Me  w>*r,  sny  research  effort  concerned  with  one  of  these  con 
proceed  (ogles! l>  only  if  the  other  two  aspects  of  the  over-CU  problem 
ere  kept  9 »  mind,,  A  block  dl*g?*«  depicting  the  tuhdlvision  of  the 
ndopttve  control  proto  let*  into  its  three  logics!  phases  Is  shown  in 
Fig.  1-1. 

This  research  Is  concerned  with  a  new  method  for  achieving  modifi¬ 
cation  assuming  that  identification  information  is  available  continuously 
end  that  an  index  of  performance  has  been  specified.  The  Index  of  per¬ 
formance  to  be  used  in  this  re-search  Is  formulated  in  Cluster  2. 

Since  this  research  deals  with  so  approach  to  the  modification  prob¬ 
lem,  only  a  summary  of  the  salient  features  of  the  Identification  and 
decision  phases  of  th**  over-all  problem  Is  given  here. 

1.3  The  Identification  Problem 

The  Identification  problem  Is  the  problem  n"  obtaining  a  descrip¬ 
tion  of  the  relationship  be  ween  the  Input  mttt  and  the  output  eft)  of 
an  unknown  dynamic  process  as  shown  In  Fig.  1-2.  Mathematical ly,  the 
problem  la  one  of  determining  the  functions!  transforms? ion  6  between  the 


variables  mttl  and  t;(ti  givwn  by 
cttl  ■  6  |mf 
whore  ?  Is  the  Independent  variable,  time. 


(1-1) 


Two  basic  requirement*  of  any  identification  procedure  or* s 


1.  It  must  perform  the  identification  function  without  excessively 
disturbing  normal  operation  of  the  dynamic  process. 
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2 .  It  must  perform  the  identification  function  in  an  Interval  of 

time  comparable  to  the  interval  of  time  for  which  the  significant 
Identification  information  is  valid. 

Both  requirements  are  essentiel  in  order  to  perform  adaptation  con¬ 
tinuously  without  recourse  to  halting  system  operation,  taking  measurements, 
and  spending  considerable  effort  In  computation  in  order  to  obtain  identi¬ 
fication  information. 

For  the  impulse  response  representation  the  functional  transformation 
G  of  Eq.  1-1  assumas  the  form 


G  rM 


v  » 


+  s. 


m-1 


p*-1  4 


>.  +  *1  P  +  aQ 


b„  p"  4  b 


X  _  j  4.  h  D  4  b 

n-1  H 
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where  p  ia  the  operator  ■  is  required  for  physical  realizability. 


end  the  a|  ond  b|  are  constants  or  slowly  varying  functions  of  time  t. 

Various  identification  schemes  have  been  investigated  by  Brai*n  [ilj, 
KeCmcn  jli],  Turin  [id],  and  Joseph,  et  at.  Q s] .  Thaaa  methods  will  not 
be  reviewed  hare  because  they  ere  not  relevant  lu  the  work  which  follows. 
However,  the  approach  to  the  identification  problem  given  by  levin  [id] 
could  te  used  with  the  solution  of  the  modification  problem  given  In  this 
research  to  form  a  complete  adaptive  control  system.  Levin's  procedure 
for  Identl f Scat  I on  Is  outlined  below. 

The  method  proposed  by  levin  employs  sampling  of  the  Input  and  output 
signeie  of  the  dynamic  process,  and  requires  no  special  test  signal  at  the 
lr  iut  to  the  process  being  identified.  This  latter  property  permits 
Identification  of  dynamic  processes  within  control  loops,  e  feature  which 
Is  needed  In  the  adaptive  controls  developed  in  this  research.  Slnco 
the  procedure  can  be  repeated  per iodlcel iy.  It  is  appllcabls  to  linear, 
eiowly  time-virying  processes.  The  scheme  ie  similar  to  crqe#M;«rrrp«'\on 
[17]  since  the  result  of  each  Is  s  set  of  sample  points  of  lihfi  im¬ 

pulse  response  of  the  dynamic  process. 
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The  modal  assumad  la  Indies fad  in  Fig.  1-3.  Tha  procaa*  input  is 
danotad  by  mini  and  tha  raaulting  output  by  ctn)  whara  n  danotaa  tha 
numbar  of  tha  sampling  instant.  Tha  sampling  Instants  ara  assumad  to  ba 
aaparatad  by  soma  tlma  Intarval  tB  so  that  tha  nth  sampling  instant  corra- 
sponds  to  tlaw  t  ■  nt  .  In  ordar  to  davaiop  a  raal Istic  idantl f I cat  ion 

m 

procadura,  Lsvin  assuawd  tha  prtsanca  of  uncartalnty  in  tha  maasurad 
output.  This  la  danotad  by  tha  dlsturbanca  u(n)  which  is  asauaad  to  ba 
a  stationary,  Gaussian,  whits  nolaa  signal  with  zero  maan. 

In  tha  dlacrata  formulation,  tha  saquanca  of  output  valuas  of  tha 
aaatmtad  modal  bacomas 

elnl  •  wlp)  m(n-p)  ♦  u(nl  11-31 

p"0 

for  n^  p. 

Physically  oniy  a  finita  numbar  of  tha  w(p)  can  ba  datarmlnad  and, 
hanca,  tha  Impulsa  rasponsa  Is  approximatad  by  a  finita  sat  of  valuas, 
wto),  wtil,  ...  ,  w(P)  whara  P  is  chosan  such  that  wlp)  pi  0  for  pS»P. 
This  approximation  la  usually  valid  for  most  physical  systsms. 

A  typical  sat  of  input  and  output  observations  ara  shown  In  Fig.  1-4 
to  Indlcata  tha  raiatlon  of  ona  to  tha  othar.  Tha  following  assumptions 
wars  mada  by  Lavin  In  tha  derivation  of  tha  sat  of  algabralc  aquations 
whose  solution  givas  tha  wlnli 

1.  wlp)  •  0  for  p>P  for  soaia  P>0. 

2.  min)  la  obaarvad  for  O-Cn^H  and  Is  not  Idantically  zaro  In 
this  Intarval, 

3.  eln)  la  obaarvad  for  0$  ♦  P. 


Dy>um3c 

Proc««« 

w<n) 


-  9  - 


The  r«»ult«  of  Lovin'*  dor I  vat  I  on  may  bo  aunmarlxed  roadl I y  If  the 
following  matrix  notation  la  employed* 


c(P) 

c(P  4  1) 


ctP  4  N) 


(1-4) 


and 


"  # 
w(0) 

w*(1) 

W*IP) 


•IP)  m(P  4  1) 

mIP  -  II  m(P) 


«> 


m(0)  mil) 


11-5) 


m(P  4  N) 
•IP4N-1I 


(1-tf) 


m(N) 


where  w#(n)  la  the  boat  mean-aquare  eatlmato  of  wfn)#  ttio  latter  being 
f  o  exact  value  of  the  impulae  response  wttl  at  time  t  ■  nta, 

Then  according  to  Lovin' a  development,  the  »*l«l  satisfy  the  normal 
aqua t Iona 

H  H"[*1  •  [«]  H  «->. 

where  [a]  la  the  tranapoaa  of  the  matrix  [mj. 

*  email  specie I -purpose  digital  computer  could  be  deaigned  and  pre¬ 
programed  to  solve  the  aet  of  equations  Indicated  In  Eq.  1-7.  Thin 
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Information  could  than  bo  utilized  by  the  modi f leaf  ion  portion  of  the 
adapt  1 v*  *ystom, 

1,4  Tha  Dae I  a loo  Problem 

The  decision  problam  daala  with  the  development  and  specification 
of  analytical  method*  by  which  dynamic  process  performance  can  be  evalu¬ 
ated  and  from  which  a  strategy  to  achieve  adaptation  can  be  evolved. 

The  most  common  method  of  procasa  avaluation  utilizes  the  notion  of  an 
index  of  performance.  An  index  of  performance  la  dafintd  as  a  functional 
relationship  involving  dynamic  process  characteristics  In  such  a  manner 
that  tha  optimum  operating  charactarlstics  can  be  determined  from  it. 

Numerous  indlcas  of  per f ones nee  have  been  treated  In  the  literature 
jj8,  19,  2o].  Hence,  only  the  concepts  which  underlie  the  index  of  per¬ 
formance  to  be  developed  in  Chapter  2  and  used  In  this  research  are  given 
here. 

The  moet  common  indices  of  performance  used  In  present  day  control 
tachnology  art  those  which  employ  some  arbitrary  function  of  systam  error. 
In  this  contaxf  systam  error  la  dafinad  to  be  the  difference  betwemn  the 
desired  value  of  tha  process  state  and  the  ectuel  velue  of  the  process 
stats.  Symbolically, 

I  *  F jaf  tTj  11-81 

where  I  *  Index  of  performance 
eltl  ■  system  error 

f  ■  some  arbitrary  factions!  operation. 

In  applying  the  concepts  of  dynamic  programming  to  tha  optimization 
of  control  processes^  Bellman  [jjl]  postulated  e  rather  broad  class  of 
Indices  of  performance  In  terms  of  coat  functions.  Consider  the  dynamic 
process  shown  In  Fig.  1-5  and  let  the  state  of  the  process  be  characterized 
by  e  vector*  cltl  and  let  mttl  be  the  Input  or  control  vector.  Further, 

*A  vector  as  used  here  le  defined  as  a  column  matrix. 
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let  c0t»)  represent  the  desired  state  of  the  process,  S  jj:0ltl  -  cltl| 
be  a  function  measuring  the  coal  of  deviation  of  c^(t>  from  c0lf),  and 
M  [ml  t »]  be  a  function  Measuring  the  coat  of  control.  Then  the  total 
coat  function  or  index  of  performance,  denoted  inf  t  l~J  ,  bee  now* 

'  J  mltl]  »  Q  [Vo(t»  -  clttj  +  H^mltl].  1 1-91 

Observe  that  the  total  cost  function  consists  of  two  parts.  The 
first  Is  actually  a  measure  of  system  error  as  discussed  earlier,  while 
the  second  is  a  measure  of  the  amount  of  control  effort  exerted  in  driving 
the  process  from  Its  present  state  to  the  desired  state.  While  dynamic 
programming  concepts  era  not  used  In  this  research,  the  formulation  of 
Eq.  1-9  and  its  interpretation  as  a  compounded  cost  function  is  basic  for 
the  work  to  follow. 

1.9  The  Modification  Problem 


After  the  Identification  and  decision  problems  have  been  solved,  the 
adaptive  loop  must  adjust  or  modify  the  dynamic  process  to  bring  It  to  the 
desired  state.  Modification  is  usually  baaad  on  the  following  information: 

1.  The  desired  state  of  the  dynamic  process. 

2.  The  present  state  of  the  dynamic  process. 

3.  The  character  of  the  input-output  relationship  of  the  dynamic 


process. 

4.  The  Index  of  performance  chosen  as  the  measure  of  system  per¬ 
formance. 

Conceptual ly,  the  modification  phase  of  the  adaptive  control  problem 
awy  be  viewed  es  computer  control  of  the  dynamic  process  as  shown  in 
Fig,  t-6.  Typical  operations  which  might  be  required  of  the  computer  con¬ 
troller  Include  evaluation  of  the  index  of  performance,  generation  of 
control  signals  for  the  adjustment  of  parameters,  and/or  generation  of  new 
signals  to  ba  applied  directly  to  the  Input  of  the  dynamic  process. 
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called  control  signal  modification  as  shown  In  Fig.  1-7.  Control  slonal 
modiflcat!  i  I*  defined  a«  the  application  of  linear  time-varying  and/or 
noAllMtr  operations  on  tha  actual  ayatam  Input  to  derive  a  control  signal 
which  actuatoa  the  dynamic  process.  Thla  approach  landa  I  teal f  to  two  In- 
terpratut t on*  which  ara  farmed  psramater  adjustment  and  control  signal 
aynthaala. 

Parameter  Adjuatwanjt .  Thla  mathod  par forma  modification  by  adjusting 
tha  parameters  of  tha  dynamic  process  and/or  a  compensation  achama  to  sat¬ 
isfy  the  Index  of  porformonco.  Sea  Fig.  1-8.  Since  the  control  require¬ 
ments  vary  with  time  duo  to  chongoa  la  process  dynamics  and  process 
signals,  tha  odjuetsmnt  of  tha  parameter a  la  a  time-varying  operation. 
Clearly  this  approach  achieve a  modlf Icetlon  by  direct  recourse  to  tho 
shaping  of  the  dynamic  process  transient  response.  The  work  of  Andaman, 
eV  el,  [22]  le  one  of  tho  more  Interesting  applications  of  tho  poremotor 
adjustment  method,  Tho  system,  which  le  shown  In  Fig.  1-0,  utilizes  the 
Impuiae-roaponee-eree  ratio  ee  the  index  of  performance.  Tho  technlgue 
provides  a  means  for  tho  system  to  adjust  Its  parameters  for  optimum  dy¬ 
namic  response  by  using  a  null-type  Index  of  porformonco. 

Tho  parameter  adjustment  approach  modi f las  the  control  signal 
Indirectly  by  manipulating  the  parameters  of  the  elements  employed  In  the 
over-oil  system.  Its  primary  function  Is  to  shape  the  dynamic  process 
transient  response  is  accordance  with  the  dictates  of  the  Index  a#  per¬ 
formance. 

Control  JiasiL  Synthesis.  Rethcrr  then  modify  the  control  signal  In¬ 
directly,  thla  approach  utilizes  tha  Ideotlf leaf  Ion  and  decision  Inform¬ 
ation  to  syntheolze  o  now  control  signet  which  la  then  used  to  setuste  tha 
dynamic  process.  The  scheme  is  shown  In  block  tflagram  form  In  Fig.  1-10. 
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Basically,  this  approach  Is  concerned  with  obtaining  an  opt'mum  approxi¬ 
mation  to  the  desired  responoa  by  opsrallng  on  tha  inPormatior,  con  to  load 
lr>  tha  index  of  performance  to  derive  tha  octcstlng  signal. 

Us  cartain  application*  It  My  ba  Impossible  to  altar  tha  character 
of  tha  dynamic  procass  or  of  a  compensation  achsau  In  ordar  t®  achieve 
optlmue  oparatloa.  This  nituotlon  will  orloa  In  thoaa  caoaa  where  procass 
parmaatars  must  ha  control  lad  Indlractly  oacausa  tha  procaas  has  no  physi¬ 
cal  edjusheents  aval  labia. 

In  sunmary,  both  approachaa  sra  concerned  with  si  taring  tha  natura 
of  tha  control  signal  which  actuates  tha  dynamic  process  balng  control  lad. 
Hosmver,  tha  first  mot hod  achieves  this  goal  indlractly  by  acting  through 
tha  adjusts® la  ayatam  parameters,  wharaaa  the  second  doss  It  directly  by 
creating  a  maw  control  signal.  While  tha  p aroma  tar  adjustment  method 
shapes  trcnoiant  response  dlractly,  tha  control  oignal  synthesis  schema 
treats  It  Indlreitly  elnet  tha  process  inputs*  response  will  Invariably 
appear  In  tha  formulation  of  tha  index  of  performance.  In  a  sanaa,  tha 
two  approaches  are  similar  with  tha  rolaa  of  transient  responoa  shaping 
end  control  signal  generation  inter-changed.  However,  It  la  useful  to 
ooporota  tha  two  in  an  operational  senea. 

1,6  Research  Objectives 

Tha  first  objective  of  this  raa»areh  la  to  develop  a  new  class  of 
adaptive  controls,  Tha  ultimata  result  will  be  a  control  conf  I  (jurat  I  on 
which  fa  optimum  in  s  specific  mathematics!  sense  and  Is  readily  res  I (ar¬ 
able  with  aval  labia  physical  components.  Tha  concord-  of  predict  lor  and 
interval  control,  which  sra  defined  fn  Chapter  2,  will  bo  employed  to 
achieve  this  objective.  The  focal  point  of  the  first  research  objective 
Is  modi f icefloe  b'  control  signal  synthesis. 


-  ia  - 

The  Mcond  objective  of  tnla  work  is  to  evaluate  the  performance 
cheracterietlce  of  tMs  new  class  of  adaptive  controls.  Analytical  and 
experimental  methods  are  employed  to  achieve  »hls  second  objective.  The 
results  of  the  two  methods  ere  compared  and  used  to  evaluate  the  class  of 
adaptive  controls  developed. 
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CHAPTER  2 

DEVELOPMENT  OF  THE  MODIFICATION  PROBLEM 

The  purpose  of  this  chapter  Is  to  develop  the  modification  problem 
in  terms  of  the  concepts  of  prediction  end  interval  control,  end  to 
formulate  the  index  of  performance  to  be  used  in  this  research, 

2.1  Prediction  in  Adaptive  Control 

A  number  of  researchers  £23,  2dj  have  investigated  the  use  of  predic¬ 
tion  In  conventional  cossnunlcetlon  end  control  systems  with  reasonsble 
success.  It  Is  to  be  expected,  then,  that  the  Incorporation  of  prediction 
In  adaptive  controls  might  aid  the  over-all  system  In  combating  erratic 
end  undesirable  behavior  in  the  dynamic  process.  By  anticipating  wide 
variations  of  the  actual  response  from  the  desired  response,  the  adaptive 
loop  is  given  "lead"  time  to  synthesize,  with  the  aid  of  a  specified 
Index  of  performance,  the  control  signal  which  will  offset  the  effects  of 
these  variations,.  Hence,  prediction  appears  to  be  a  desirable  feature  In 
adaptive  controls, 

2.2  Concept  of  Interval  Control 

Prediction  must  be  based  on  the  post  history  of  the  function  being 
predicted.  Also,  well-known  results  from  prediction  theory  [29*|  Indicate 
that  prediction  accuracy  deteriorates  with  an  Increasing  prediction  in¬ 
terval  length.  Hence,  e  finite  prediction  interval  length  T  must  be  used 
to  maintain  e  specified  prediction  accuracy. 

Because  of  this  prediction  requirement,  a  reasonable  engineering 
approach  to  the  modification  problem  Is  to  divide  ihe  process  control 
into  Intervals  of  langth  T  ss  shown  In  Fig.  2-1.  Than,  Information 
gathared  during  the  interval  -  TeftjgO  can  bo  used  to  schlevs  optimum 
control  over  the  interval  0  <■  t  T,  By  letting  t  -  0  be  the  present 
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Urn*,  the  interval  0  <  tjf  T  >*ay  b«  chosen  as  the  reference  Interval  over 
which  the  process  is  t>  be  optimized.  Hence,  with  respect  to  actual  *y«- 
tem  time,  the  point  t  »  0  corresponds  to  the  beginning  of  a  control 
Interval  of  length  T  Into  tl»  future.  By  using  a  fixed  prediction  Inter¬ 
val  length  T  end  operating  on  date  as  they  occur  in  the  interval  -T <  t  <  O, 
a  prediction  of  the  desired  response  and  actual  response  of  the  dynamic 
process  for  the  interval  OCtd  T  can  be  obtained  during  the  former  in- 
terv  I.  This  result  then  permits  the  adaptive  loop  to  take  action  at 
t  *  0  to  optimlza  dynamic  procass  per forma net  during  the  reference  control 
interval  0«  t«T. 

This  subdivision  of  the  optimization  into  intervals  will  permit  the 
use  of  the  classical  z- transform  method  [jwj  to  analyse  certain  responaa 
cherec tari sties  of  the  claaa  of  controls  developed, 

3.3  Formulation  of  an  Index  of  Performance 

Consider  the  slngle-dimnneionef  dynamic  process  shown  in  Fig.  2-2 
having  the  Input  variable  mltl,  the  output  variable  cltl,  and  external 
disturbance  uSt),  and  the  unit  impulse  responaa  »(t,f I  which  is  time- 
varying  as  a  function  of  environment  E.  The  unit  Impulse  response  wit,?*  I 
la  defined  hara  as  the  response  of  the  dynamic  process  at  time  t  to  an 
Impulse  applied  at  time  T.  A  modified  least  wquarea  index  of  performance 
will  be  formulated  fsr  this  process  by  considering  an  Interval  of  length 
T  In  the  future,  where  t  «  0  I*  taken  a*  the  present  tls»e.  It  will  differ 
from  conventional  least  squares  Indicts  of  performance  In  the  following 
ways* 

I*  The  process  will  be  opt  HI  zed  over  a  future  Interval  of  time  T 
and  no  errors  before  t  ■  0  wl 1 1  be  weighted. 

,  Provision  will  be  made  for  unequel  weighting  of  syetem  error 
during  the  control  Interval. 


? 


Dynamic  Proeaaa  with  Tint-varying  Input 
RnpoAM  wit.'I't, 
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3.  Th*  existence  of  •  mod* I  characterizing  th#  desired  Input-output 
transformer  ion  of  the  dynamic  process  will  be  assiwed. 

4.  Prediction  will  be  ueed  to  eafablish  the  future  valuea  of  th* 
desired  response. 

3.  Th*  control  variable  mltl  will  ba  manipulated  In  th*  present 
It  *  01  to  optimize  process  response  In  th*  future. 

The  reason  for  not  weighting  system  errors  In  th*  past  Is  because 
no  control  con  be  effected  in  th*  present  or  future  to  reduce  these 
errors. 

In  attempting  to  optimize  th#  dynamic  proces*  of  Fig.  2-2  over  ell 
time,  th#  classical  Index  of  performance  la  th*  Integra I -square-error 


given  by 


r<x>  r  t  2 

I  «  ^  [«0m  "  cltlj  dt 


12-1 1 


where 


c0ltl  ■  deal red  procea*  response 
c(t!  -  actual  process  response 

t  •  dummy  variable  of  Integration,  flat*. 

However,  since  optimization  I*  to  be  executed  on  #  per  interval  basis  end 
c0lt)  Is  available  only  for  Oc  tas  T,  Co.  2-1  becomes 


!  •  V  jc0lti  -  cfttj  2  dt 


<2-2 ) 


In  order  to  provide  for  unequal  weighting  of  response  error*  over  th* 
control  Interval,  *n  arbitrary  weighting  factor  \  Itl  I*  Introduced  Into 
th*  Integrand  of  €q.  2-2  to  give 


-  £  X«»»  [V  "  “'3 *  dt* 


<2-3» 
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This  weighting  Inctor  la  obtained  (from  engineering  conslderntlons  based 
on  the  goals  or  objectives  of  control,  for  example.  If  response  errors 

-  —  A —  tk  *!>■• a  -  *  — —  A  — -»  1  k  MU—  —  u— :  —  — 


)^(f)  ■  £(t  -  Tl  Is  made  where  &  € 1 1  is  the  unit  Impulse  function.  If 
equal  weighting  Is  to  be  given  to  response  errors,  then  X  HI  is  simply 
e  constant.  An  Important  restriction  on  )^lt)  which  Is  necessary  to  give 
meaningful  engineering  results  Is  X(*l>  0  for  0  $  ti£T.. 

Finally,  a  cost  term  accounting  for  the  amount  of  control  resources 
utilized  to  achieve  modification  Is  added  to  Eq„  2-3  to  give 


I 


V  *<•'  [«  0it»  -  cm]  dt  ♦ 


2 

m  m  dt. 
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Clearly,  Eq.  2-4  Is  s  member  of  the  general  class  of  Indices  of  perform¬ 
ance  defined  by  Bellmen  In  Eq.  l-g  . 

The  actual  response  cltl  of  Eq.  2-4  Is  comprised  of  three  components. 
The  first  Is  due  to  the  initial  energy  stored  In  the  dynamic  process  at 
I  «  O  and  accounts  for  excitations  prior  to  t  -  0.  This  term  Is  denoted 
by  C|ft).  The  second  component  of  cltl  Is  that  due  to  the  disturbance 
ultl  and  the  third  Is  caused  by  the  new  excitation  mttt,  0  <  t  d  T,  and 
Is  given  by  the  convolution  Integral 


s 


min  **it,n  ar 
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where  r  la  the  dummy  variable  of  Integration.  Hence,  the  actual  output 
cltl  Is  given  by 


cltl  -  C| < t >  +  ultl  ♦  ^  ml n  w|t,yi  d V.  12-01 

Substitution  of  Eq.  2-0  Into  Eq.  2-4  yields  the  final  form  of  the  index 
of  performance. 
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c0itl  ”  desired  process  response  during  the  control  interval, 

cjltl  »  component  of  process  responds  during  tho  control  Interval 
due  to  Initial  conditions  nt  the  beginning  of  the  control 
interval. 

u(t>  »  component  of  process  response  during  control  Interval  due 
to  external  disturbance. 

mitl  *>  process  input  control  variable  to  be  chosen  to  wlnlmliifi 
Eg.  2-7. 

'xi I, 'f  >■  process  unit  Impulse  response  for  the  control  Interval. 

\{t)  ”  arbitrary  system  error  weighting  factor. 

Eg.  2-7  Is  an  Index  of  performance  comprised  of  two  cost  functions. 
The  first  farm  rapreaents  s  messtira  of  the  deviation  of  the  actual  dynamic 
process  response  from  the  desired  dynamic  response.  On  the  other  hand, 
the  second  term  measures  the  amount  of  control  effort  which  Is  exerted. 

The  weighting  factor  }\lfl  provides  considerable  flexibility  which  Is  not 
s  property  of  most  Integral  Indices  of  performance..  Not  only  does  It 
provide  for  unequal  weighting  of  response  errors  on  the  control  Interval, 
but  It  also  permits  a  relative  weighting  between  the  two  terms  of  the 
Index  of  performance.  Moreover,  depending  on  the  control  situations  to 
be  encountered,  a  judicious  choice  of  \ltl  will  provide  response  superior 
to  that  of  conventional  indices  of  performance.  As  a  result,  the  presence 
of  Xili  provides  the  design  engineer  with  considerable  latitude  in  scald¬ 
ing  optimum  designs. 

2,4  The  Complete  System 

The  complete  modification  problem  as  developed  In  this  chapter  may 
be  visualized  In  block  diagram  form  os  shown  in  Fig.  2-3.  The  function 
of  the  control  unit  end  signal  synthesizer  is  to  utilize  the  indicated 
Input  Information  to  generate  the  optimum  control  signet  mlt).  Clearly, 
such  •  task  could  be  accomplished  by  e  large  digits!  computer.  However, 


Flfl.  2-3 

Block  Diagram  of  Comp  I* to  Systam  for 
Performing  Mo4l f Icatlon  Function. 
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engineering  factors  such  na  size,  weight.  ond  t.n*t  <.t t~-  d !  c  t  o  f =  Int  r?.aa 

for  small,  special-purpose  computers  to  perform  the  control  task.  On*  of 
the  Oujec rives  of  this  research  Is  to  develop  a  class  of  adaptive  controls 
which  can  be  realized  readily  from  physical  components.  This  objective 
requires  keeping  system  complexity  at  a  minimum. 

In  order  to  keep  complexity  and  cost  at  a  minimum,  operation  of  the 
con; rot  unit  In  real-time  la  highly  desirable,  if  real-time  operation  can 
be  achieved,  there  will  be  no  need  for  high-speed  computing  devices  with 
their  inherently  comp'  •  inpul-output  accessory  equipment.  Computations 
In  the  control  unit  could  then  be  performed  by  analoj  components,  e.g., 
multipliers.  Integrators,  summing  amplifiers,  and  diode  function  generators 
operating  at  the  same  rat*  as  tha  dynamic  process. 

2.5  General  Const'-1.,  Mlons 

Basically,  tha  entire  adaptive  cont> ol  process  ar  developed  her*  may 
be  viewed  as  a  sequence  of  decisions  to  ba  made  every  T  units  of  time. 

This  decision  for  each  interval  T  la  baaed  upon  the  present  stele  of  the 


dyn'wilc  process  being  control  ted  and  upon  the  desired  behavior  of  tha? 
proersa  over  a  future  Interval  of  time  as  obtained  from  a  prediction 


operation. 


Since  all  possible  control  signals  rnttt  are  not  acceptable  because 


of  physical  limitations  imposed  on  the  control  problem,  the  actual  re¬ 
sponse  of  the  dynamic  process  cannot,  In  general,  he  expected  to  agree 


exactly  with  the  desired  response.  Hence,  ni.  Index  of  oerformaoce  was 
developed  to  be  used  In  selecting  the  optimise  member  from  the  class  of 
acceptable  control  signals. 


-28 


CHAPTER  5 

THE  OPTIMIZATION  PROBLEM 

The  optimfzat ion  problem  1 9  concerned  with  the  selection  of  a  physi¬ 
cally  realizable  control  variable  mltj  ><hich  will  minimize  the  Index  of 
performance,  Eq.  2-7.  In  other  words,  the  problem  of  determining  optimum 
control  deals  with  the  minimization  of  a  particular  integral  over  a  fixed 
Int.  val. 

.*  number  of  minimization  techniques  are  presented  here  as  background 
moteral  for  the  work  which  Is  to  follow.  Another  purpose  of  this  chapter 
is  to  point  out  the  conpufetirnal  difficulties  which  arise  when  optimiza¬ 
tion  of  adoptive  controls  is  considered.  The  minimization  techniques 
treated  era: 

1.  Calculus  of  variations. 

2.  Approximation  of  mlt)  by  discrete  segments. 

3.  Approximation  of  mitt  by  a  sum  of  orthonormal  polynomials. 

In  order  to  simplify  the  mathematics  and  still  indicate  the  concepts 
underlying  the  first  two  approaches,  let  the  disturbance  ultl  •  O  in 
Eq.  2-7. 

3.1  Calculus  of  Variations 

A  fundamental  probltm  In  the  calculus  of  variations  Is  to  determine 
a  function  such  that  a  particular  definite  Integral  involving  that  func¬ 
tion  and  certain  of  Its  derivatives  assumes  a  maximum  or  a  minimum  value 
[27],  The  application  of  this  mathematical  tool  to  the  optimization  of 
control  ayetams  was  a  major  step  In  the  davalopmant  of  analytical  control 
theory  as  shown  in  Newton  {3,  p.  nsj. 

The  application  of  this  technique  will  be  considered  for  the  clees  of 
adoptive  controls  discussed  In  Chapter  2  end  conclusions  will  be  drawn  as 
to  the  feasibility  of  the  method  for  this  elaae. 
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wi?n  ?n«  Hu&at I Vu? Ion  yft)  «  0  Eq.  2-7  becomes: 

rTf 


f»Ts  r*  **t  -j  2  7 

1  -  j  [com  -  c,«»  -  ^  mlYl  wlt,Y>  d?  J  +  m 2  ItlJ  dt . 


13-1 » 


In  order  to  determine  the  optimun  control  variable,  it  is  assumed  that  a 

solution  does  exist  and  is  denoted  ty  m  It).  A  variation  of  wit)  is  then 

*o  o 

constructed  by  letting 

mlt)  -m.lt)  +£*,())  (3-2) 

where  €  is  a  parameter  independent  of  t  and  m0lt)  is  the  variation  of 
alt).  If  m0(t)  is  the  optimum  control  variable  which  therefore  minimizes 
Eq.  3-1,  then  any  variation  of  £  from  zero  in  Eq.  3-2  must  cause  an  in¬ 
crease  in  the  value  of  Eq.  3-1  from  i fa  minimum.  Hence,  if  Eq.  3-2  Is 
substituted  into  Eq.  3-1,  the  derivative  of  the  resultant  equation  with 
respect  to  £  for  €  set  equal  to  zero  must  be  zero. 

Substituting  Eq.  3-2  Into  Eq..3-1  and  differentiating  with  respect 
to  €  gives 


3LL 
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J  |)l(ti  -cjiti  -  J  |m0iY)  +«"4<*y>j  »<t,r)  di»]  • 


;  m  cri  wit,r ) 

0  * 


dt. 
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From  the  argument  given  above,  if  €  -  O,  the  right  hand  side  of  Eq.  3-3 
must  be  zero.  Hence, 
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At  hough  Eq.  3-4  expresses  the  condition  for  a  win l»u»i_  l»  )>  *!! 

a  form  In  which  the  variation  m^lt)  la  separable.  Tho  solution  of  varia¬ 
tional  problems  of  this  type  la  usually  expressed  In  tha  form  of  a  dlffer- 
antlal  aquation  (caanonly  termed  tha  Eular  aquation)  with  boundary  condi¬ 
tions.  For  an  Nth  order  dynamic  process  It  is  necessary  to  integrate 
Eq,  V4  by  parts  N  times  to  obtain  tha  Euler  relation.  Hence,  without  a 
knowledge  of  tha  order  of  the  dynamic  process,  solution  of  Eq.  3-4  Is 
impossible.  Moreover,  the  presence  of  boundary  conditions,  a  natural 
consequence  of  this  type  of  variational  problem,  poses  additional  diffi¬ 
culties.  In  particular,  for  an  Nth  ordar  dynamic  process,  there  will  be 
N  natural  boundary  conditions  which  tha  solution  must  satisfy. 

In  most  physical  si  tuatlons  ihe  ordar  of  t.'je  dynamic  process  Is 
known.  Nevertheless,  tha  solution  of  Eq.  3-4  will  give  nr  Insight  Into 
tha  structural  form  of  the  adaptive  loop  other  than  to  imicate  tha  need 
for  a  complex,  high-speed  digital  computer  for  the  generation  of  m0lt). 

In  addition,  the  presence  of  boundary  conditions  will  not  permit  sequential 
computations,  but  will  requirs  trial  end  error  calculations  for  solution 
of  s»  (t>. 

Q 

Clearly,  the  calculus  of  variations  approach  imposes  heavy  demands 
on  tha  computational  ability  of  the  adaptive  loop  In  order  to  optimize 
the  dynamic  process  response,  Extensive  numerical  computations  are 
necessary  which  will  obscure  the  relationship  betwaan  adaptive  and  non- 
edeptlve  controls.  As  a  result,  thla  approach  la  not  tractabla  from 
either  an  analytical  or  experimental  viewpoint  for  the  purpose#  discussed 
in  Chapter  2, 

More  recently  Bellman  |  28,  Ch.  sQ  has  developed  a  new  epproech  to 
calculus  of  variations  problems  in  terms  of  dynamic  programming.  Although 
the  method  offers  some  hope  for  Ihe  application  of  the  calculus  of  varia¬ 
tions  to  the  adaptive  control  problem,  it  le  computationally  cumbersome. 


Sn  thl*  v u" : ' nuout  control  optimisation  problem  which 

<*>  Mussed  In  th.  |„t  net  I  on  will  b.  k~  --  -Ppro<,!mi>;.;y 

equivalent  discrete  formulation.  Th*  Interval  from  t  -  O  to  t  -  T  Is 
Partitioned  by  .  saquenc.  0,  pointg  ^  v  ...  ,  f|jl  Mper.ted  by  . 

d,‘t*nC*  A  A  “  i  •-  ■  •««•••  **•  nunb.r  of  partition  points. 

Th.  control  v.rl.b,.  ,3  then  approximated  by  .  s.qu.nc.  of  -lscrtt.  I#vel# 

%  ••  shown  In  Fig.  3-T.  Th*  integral 


it» «  f  »<n  w<t,r » dr 


Is  approximated  by  th*  sun 


cn  ■  A 


">  J 


e  ■  o 

V) 


j  >■  n 


»„j  -  0  lor  J»  th.t  j,.  „01  Kttu 

l>.  1.1  ur.  ..I...,  ,ta  c(  v„u„ 

*fi1*  c2»  •••  •  *|f>« 

The  component  of  the  output  due  to  initial  condition.  c,lt>,  end  the 
system  error  weighting  factor  >ftl  are  sf.o  approximated  by  sequ.,c..  of 

v«  ues,  lc,^  cj2,  ...  ,  c,^l  end  I  \ ,,  \  2,  ...  #  X  M),  reapectively. 

Tha  asm*  Is  don*  for  th*  desired  response  c0lt>. 

Using  the  -bov  definition,  end  approximating  the  index  of  perform- 
*nct#  Eq.  3-1.  by  e  sum  gives 


1  “A  Xn  [C°«‘C«n  -C«]2  +  mna 


The  optimisation  problem  for  this  cam  d.ela  with  the  choice  of  the 
«n  such  thet  Eg.  3-6  I,  •  minimus,  therefore,  for  any  In teger  k,  th.  con¬ 
dition  for  a  minimum  value  of  Eq.  3-a  I* 


Discrete  Segment  Approximation  of  Control  Variable  mlf) 


4«F-*frr>‘ 
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^"k 

for  all  k,  li  >  1,  2,  ...  ,  N.  Performing  the  Indicated  dl f farentlatlon 
and  sotting  the  result  equal  to  zero  gives 

,5"'0, 


for  k  ■  i,  ?(  ...  ,  h. 


Since 


-  A  *  w- 


n)  h 


n  <  k 


n  A  h 


<3-111 


0-121 


the  condition  lor  s  minimum  becomes 


i{X"  t-  '  Ch,  "  '"]  “«  "  "V  “ 


0-131 


en  •  A>  *nj  "n  J- 
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Eq.  3-13  actus  My  represents  N  linear  algebraic  equations  In  N 
unknowns.  The  equations  must  be  solved  simultaneously  at  the  beginning 
of  each  control  lnterve.1  to  gUe  the  optimum  control  varlebte  as  a 


34  - 


sequence  of  values  I _ ,  fcr  tUt  mnii  ui  interval.  inia 

formulation  I*  more  amenable  to  digital  computation  then  the  first 
method  considered,  but  still  obscures  any  real  Insight  which  one  may 
hope  to  gain  about  the  structure  of  the  adaptive  loop. 

An  approach  to  the  simultaneous  solution  of  Eq.  3-13  Is  obtained  by 
considering  the  last  member  of  this  aet  (k  -  N)  which  Is 

A  [%l  “  %  ~  WhM  "h]  "HM  “  mH  "  °-  ,3-15) 

Since  aig  Is  the  only  unknown,  Eq.  3-13  Is  easy  to  solve,  The  solution  of 
Eq.  3-13  may  then  be  substituted  Into  Eq.  3-13  for  k  ■  N  -  1 ,  and  the  re¬ 
sulting  equation  solved  for  Its  only  unknown,  .  Hence,  the  solution 
of  the  set  of  equations  given  by  Eq.  3-13  propagates  backward  through  the 
set.  The  use  of  high-speed  digital  computation  Is  ogaln  mandatory  to 
determine  the  optimum  control  variable.  Here  again  no  Insight  Into  the 
real  nature  of  adoptive  control  can  be  gained. 

3.3  Orthonormel  Polynomial  Sum  Approximation 

For  e  large  class  of  adaptive  control  problems  the  use  of  a  high-speed 
digital  computing  facility  Is  undesirable.  Such  factors  as  size,  weight, 
end  cost  ere  paramount  In  practical  applications.  Unfortunately,  ths  neces¬ 
sity  of  high-speed  digital  computation  has  besn  a  natural  consequsncs  of 
the  two  optimization  procedures  considered  thus  far.  While  these  mathe¬ 
matical  procedures  for  optimization  are  well-defined,  the  end  resulta  do 
not  lend  thsmselvea  to  a  well-defined  engineering  Interpretat Ion.  The  only 
Interpretation  has  been  that  large-scale  digits!  computation  Is  necessary. 

What  Is  really  sought  here  Is  a  sat  of  reasonable  assumptions  based 
on  engineering  considerations  which  will  simplify  the  optimization  proce¬ 
dure,  keep  the  complexity  of  the  adaptive  loop  at  a  minimum,  give  reason¬ 
able  over-all  system  performance,  and  be  consistent  with  the  objectives 
of  adaptive  control  as  discussed  In  Chapter  2. 
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first,  the  optimum  control  signal  mft)  should  be  one  fhet  in  physi¬ 
cally  realizable.  That  is,  it  shnni  i  -e*  zzr.i) oi  u>  impulses  or  higher 
order  singularity  functions  which  will  Invalidate  the  assumotlon  the* 
the  dynamic  process  eon  be  characterized  by  a  linear,  time-varying, 
weighting  function  wit,'?').  Secondly,  mit)  should  be  relatively  simple 
to  synthesize  during  normal  operation  of  the  system.  This  second  fee Kr 
Implies  simplicity  uf  the  adoptive  loop.  Thirdly,  the  mathematical  for¬ 
mulation  of  mltl  should  lend  Itself  readily  to  an  optimization  procedure 
which  Is  simple  and  whlcn  gives  physical  insight  Into  the  form  of  the 
adaptive  loop. 

The  approximation  of  mlt)  by  sn  K-le'*  sum  of  orthonorma!  polynomials 
In  t  is  considered  in  this  section.  This  approximation  Is  defined  by 


mltl  ■ 


m  p  it) 
n  n 


(3-16) 


where  the  mn  are  the  coefficients  which  a^e  to  be  determined,  and  the 
Pnltl  are  polynomials  In  t  which  ere  orthonormal  over  the  Interval  (o,t]. 

In  other  words,  the  set  of  polynomials  satisfies  the  following  two  con- 
di tlonat 

la)  Pfllt)  i»  “  polynomial  In  t  of  dtgree  n. 

1  k  »  n 

Cbl  \  p.lt)  p  |f|  dt  ■  13-17) 

*T>  0  kin 

where  T  is  the  control  intervaf  length.  These  polynomials  ere  the  Legendre 
polynomials  with  their  usual  Interval  of  orthonormall ty  £-1,  l]  trans¬ 
formed  Into  the  Interval  £o,  tJ  . 

Ths  input  signal  thus  becomes  a  polynomial  in  t  whose  degree  la 

dictated  by  the  particular  N  chosen.  The  coefficients  m  ,  m_,  etc., 

0  1/ 

will  be  generated  by  the  adaptive  loop  In  response  to  changes  In  process 
dynamics  end  the  desired  response. 
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Th«  motivation  for  using  orthopormel  polynomials  in  t,  rather  than  a 
Taytcr  series  expansion  as  In  Braun  [12],  for  mttl  Is  tha  hop*  that  the 
coefficients  mn  can  be  generated  Independently  for  each  control  interval 
ip  the  former  case.  If  this  can  be  done,  the  signal  synthesis  portion 
of  the  adaptive  loop  can  assume  the  form  shown  In  Fig.  3-2. 

I  *  will  be  shown  that  Independent  generation  of  the  mn  is  possible 
In  real-time  by  means  of  time-varying  gains  and  integrators.  Clearly, 
suen  a  scheme  tv! 1 1  avoid  the  necessity  of  complex  high-speed  digital  com¬ 
putation,  and  will  of  far  considerable  simplicity  In  system  design.  The 
detailed  treatment  of  this  approach  Is  prssented  In  Chapter  4. 


Signal 
of  Control 


rnthaai*  for  Inclapsni'nnt 
Signal  Coofficiant*. 


Geiii.'rflt  i  on 
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CHAPTER  4 


DERIVATION  AND  ANALYSIS  OF  THE  OPTIMUM  CONTROL  CONFIGURATION 


The  purpose  of  this  chapter  la  to  Invest (gate  the  last  approach  to 
the  optimization  problem  which  la  given  In  Chapter  3.  The  control  enuo- 
tiona  are  developed  and  the  optimum  control  configuration  is  derived. 

In  addition,  a  theoretical  analysis  of  certain  character  I  at  lea  of 
the  class  of  adaptive  controls  developed  la  presented.  A  theoretical 
system  transfer  function  Is  derived  and  applied  to  a  stability  analysis. 
Limitations  of  the  transfer  function  appi  oach  are  also  discussed. 
Finally,  since  this  class  of  adaptive  controls  employs  prediction,  accu¬ 
racy  requirements  In  terms  of  the  prediction  operations  are  discussed 
briefly. 

4.1  General  Condition  for  Optlmwn 

The  three  equations  from  which  the  general  condition  for  optimum 
control  will  be  derived  are  repeated  below: 


■  £ 


C„<tl  -  c»t>]  +  m2ft)^ 


* 


12-4} 


r 

•»n 


cm  -  c,<t»  +  um  +  \  wit,y>  at  «2-aj 


and 


m< 


u.± 


pnm 


f3~lG) 


for  0(  t  <  T.  The  terms  In  these  equations  have  been  defined  previously. 
It  Is  assumed  here  that  the  disturbance  is  a  stationary,  Gaussian,  win  to 
noise  process  which  is  independent  of  the  Input  signal  mitl. 

The  values  of  the  various  mn,  n  »  0,  1,  ...  ,  N,  needeo  to  minimize 
Eq.  2-4  ere  obtained  by  differentiating  the  equation  with  respect  to 


m  K  k  'J,  1,  ...  ,  N,  >y~/l  setlln.}  thp  ojunt  tn  ;ors,  TfUrs , 


iL-A 

■&  mk  Jn 


^m[y„  -  c"'][.|^T] 


d  mill 


dt  »  0 


for  k  «  0,  1,  ...  ,  N. 
From  Eq.  3-16 


~L?iu  -  pk(M 

*  *k 


end  from  Eq.  2-6, 


l^LLL  h  \fl_!ni21>  w<t,r  j  qr 

m,.  0^  m. 


m|(  *o  (>  mk 

for  k  ■  0,  1,  N. 

Substituting  Eq.  4-2  into  Eq,  4-3  yield* 


~--lt-)  ■  \  p  :r>  **it,r)  dr 

^  m,.  dn  h 


"k  0 


for  k  ■  0,  1,  H. 

From  £qs.  3-16,  3-17,.  end  4-2,  the  laet  term  of  Eq.  4-1  become* 


!‘T  ...  mill  ., 

I  mill - dt  ■ 

>0  3  mk 

which  simp  I  I  fie*  to 


E  [i„  •- p",,;]  p‘"’ ■” 


f  ....  * 

j0  a 


dt  ■  mfc 


because  of  the  orthonormef I ty  of  the  polynomials  for  k  *  0,  1,  ...,  N. 
Substituting  Eq*.  4-4  end  4-6  into  Eq.  4-1  gives 


Si  XU1  E 


c„m  -  cm 


>J  |~  §  p«<r j  w(t,r>  <tr  at  +  m„  ■  o 


for  k  ■  0,  1,  hi,  Eq.  4-7  actually  represents  N  linear  algebraic 
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equations  in  as  many  unknowns  since  el M  Is  also  a  function  of  the  as 
seen  from  Eqa.  2~i5  and  3-16.  These  ’quatinns  con  be  solved  explicitly 
for  the  m^  providing  c  j '  1 1 ,  u(M,  and  w,'i,T't  are  known.  Such  a  solution 
would  again  require  the  use  of  a  high-speed  digital  computer  In  the  adop¬ 
tive  loop  In  order  to  control  the  dynamic  process.  However,  an  approximate 
solution  can  be  obtained  by  considering  an  estimate  or  prediction  of  the 
quantify  (c0ltl  -  cttJj. 

The  coefficient*  mk  which  are  needed  for  a  particular  control  inter¬ 
val  muat  be  available  at  the  beginning  of  that  Interval  according  to 
Eq.  3-16.  But  Eqa.  2-6  and  4-7  indicate  the  mk  depend  upon  the  reaponsea 
c0(tl  and  eftt  during  the  same  Interval.  However,  if  the  quantity 
£cott)  -  eltl]  can  be  estimated  T  units  of  time  in  advance.  It  is  possible 
to  employ  Eq.  4-7  directly  to  estimate  the  values  of  the  for  the  succeed¬ 
ing  Interval.  That  is,  the  coefficient  rok  for  the  Pth  interval  can  be 
generated  by  real-time  operations  during  the  (P-llth  interval. 

In  order  to  apply  the  notion  of  prediction,  define 

£c0<t)  -  cltij  «  best  available  estimate  of  |jc0(tJ  “ 

T  unite  of  time  in  advance. 


Eq.  4-7  car.  then  be  solved  directly  for  the  estimated  mk  to  give 

-dt  I 4-8 ) 
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^0.*>  -  citij pkir»  wit,r » <ir  |j-o 
for  k  “0,  1,  N. 

Let  a  time-varying  gain  < 1 1  be  defined  by 

Kkm  \  pkiri  *it,r>  dr 
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for  k  ■  0,  1,  ....  N  where  0  T'^t^  T. 


When  Eq.  x-V  Is  subst  f  til  ten  info  Eq.  4--8,  the  r?suVt  is 

*  mk  *  ^  Kk,,>  [v*.  -  cmj  dt  i 4-10) 

far  k  *  0,  1,  N.  Wi th  a  change  In  th*  Index  of  summation,  Eq.  3-18 

becomes 

K_ 

mlt)  «  ^  pk 1 1 »  14-11) 

k*- I 0 

for  0  j£  t  as  T. 

Eq,  4-10  Is  th*  gene  si  condition  for  the  optimum.  The  combination 
of  Eqe.  4-10  and  4-11  constitutes  the  control  laws  for  a  class  of  predic¬ 
tive  adept! ve  controls.  Eq.  4-10  indicates  hew  the  coefficients  for 
any  control  interval  P  can  be  obtained  by  real-time  computation  during  the 
preceding  control  Interval,  IP-1).  Eq.  4-11  indicate#  how  these  coeffi¬ 
cients  are  combiner  with  their  corresponding  polynomials  Pktti  to  generate 
the  optimum  control  vsrieble.  The  fact  that  the  optimization  procedure 
presented  he-e  renders  ths  Index  of  performance  Eq.  2-4  a  minimum  Is 
demonstrated  In  Appendix  6. 

Eq.  4-10  suggests  a  formal  synthesis  procedure  for  the  generation  of 
the  which  Is  shown  In  Fig.  4-1.  Each  of  the  m^  Is  then  multiplied  by 
its  corrospondi ng  p^it)  end  the  results  summed  to  give  mlt)  according  to 
Eq.  4-11.  The  complete  control  conf Iguretion  then  assumes  the  form  given 
In  Fig.  4-2.  The  conf iguretion  of  Fig.  4-2  ie  optimum  on  e  per  Interval 
baala.  Hence,  the  time-vurylog  gains  and  integrators  must  be  reset  at 
the  end  of  each  control  Interval  to  Initiate  computation  for  the  next  In¬ 
terval.  The  function  of  the  sample  and  hold  devices  Is  to  read  out  ths 
values  of  the  various  mk  at  the  end  of  each  Interval  and  to  maintain  these 
values  throughout  the  new  Interval. 


Fig.  4-2 

Complete  Control  Configuration 
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so  derive  the  control  variable  mlt).  The  qur-ntlty  In  (4-121  Is  simply 
the  predicted  ryatem  error.  In  other  words,  the  function  of  the  predictor 
Is  to  present  the  control  ler  with  on  estimate  of  the  future  -ystefii  error. 
The  teak  of  the  controller  is  then  to  synthesize  o  control  slgnol  which 
will  minimize  the  actual  system  error  In  the  succeeding  control  Interval. 
Hence,  over-el  I  system  operation  may  be  viewed  os  data  processing  of  the 
predicted  system  error  to  derive  the  optimum  control  signal.  The  charac¬ 
ter  of  the  data  processing  changes  to  accommodate  changes  In  the  dynamic 
process  .4t,V  >,  changes  In  the  desired  response  c0Ct),  and  changes  In  the 
Index  of  performance  which  are  governed  by  X  <t>,  the  system  error  weight¬ 
ing  factor. 

An  important  feature  of  this  class  of  adaptive  controls  Js  the  nature 
of  the  time-varying  gains  which  are  given  by  Eq.  4-0, 


Kk<t)-X<t»  i  pK<ri  **<t,rt  dr  <*~fri 

Jq 

for  k  •  0,  1,  N.  Since  the  polynomials  pk(tt  ore  linear  combina¬ 

tions  of  the  singularity  functions,  l.e.,  the  step,  romp,  and  parabolic 
functions,  etc,,  the  time-varying  gains  are  simply  the  products  of  the 
error  weighting  factor  X**l  and  I*1*  response  of  the  process  wit,?')  to 
linear  comblnat Iona  of  these  some  singularity  functions.,  Therefore,  the 
time-varying  gains  Kk(tl  are  easy  to  generate  given  a  knowledge  of  the 
dynamic  process  Impulse  response  wlt/T'l. 

The  adoptive  nature  of  the  optimum  control  conf I  gyration  Is  elver 
from  Eqs.  4-9  end  4-10,  The  time-varying  gains  Kk<t>  are  related  directly 
to  the  error  weighting  factor  X  HI  *nd  the  dynamic  process  unit  Impulse 

— . 
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I  ndex  of  'fr  far-miicf  by  <  hanging  /  ttl  ei»  the  g»#t«  of  control  change, 

and  5*  also  capable  of  accounting  for  changes  In  or'w-fss  dynamics  w(t,7/l 
all  through  iha  time-varying  gains  K^ltl. 

termination  of  the  control  lews  end  the  control  conf I guruf I  on  reveals 
three  Important  features  of  this  class  of  adaptive  controls: 

1.  The  controller  can  be  realized  using  simple  analog  components, 

2.  The  controller  operates  In  real-time. 

3.  Complex  computational  operations  have  been  avoided. 

These  three  I  terns  satisfy  the  original  goals  which  were  established  In 
the  formulation  of  the  modification  problem  {Chapter  2).  I  tan  3  Is 
actually  en  outgrowth  of  the  first  two,  but  Is  Included  for  emphasis. 

In  conclusion,  the  control  lows  of  Eqs,  4-10  and  4-11,  jnd  the  con¬ 
trol  conf Igure’ion  of  Fig.  4-2  completely  specify  the  class  of  adoptive 
controls  tc  be  studied  In  this  work.  Their  derivation  hoo  been  based  on 
the  specified  index  cf  performance,  the  assumption  of  the  ywnsral  u.,<_ }  I  one  I 
form  of  the  optimum  control  variable,  and  on  the  use  of  prediction  to  ob¬ 
tain  the  predicted  error  signal. 

4,2  Theoretical  System  Transfer  Function 

In  the  analysis  of  feedback  control  systems,  it  Is  often  desirable 
to  determine  the  system  transfer  function  If  it  exists.  In  this  section. 

It  will  be  shown  that  a  system  transfsr  function  doss  exist  theorst leal ly, 
but  Is  Impossible  to  obtain  In  general.  However,  a  slight  modification 
of  the  results  developed  In  this  section  will  permit  the  derivation  of 
stability  results  for  s  particular  sub-class  of  thsse  systems. 

Under  the  assumption  of  a  linear,  t  line- Invar  I  ant  dynamic  process 
end  id'  prediction,  the  block  diagram  of  Fig.  4-2  bacamas  that  shown 
In  Fig,  4-3.  The  assumption  that  the  controller  portion  of  tho  system 


Fig.  4-3 

Model  of  Complete  System  with  Ideal 
Prediction  and  Time- invar  font  Dynamic  Process 
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Simplified  Block  Diagram  of  System  Model. 
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will  be  demonstrated  lot  er  in  this  section. 

Using  standard  block  diagram  reduction  techniques,  the  diagram  of 
Fig.  4-3  raducaa  to  that  shown  In  Fig.  4-4  where  Sts)  la  given  by 
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The  closed-loop  transfer  function  is  then  defined  by  the  relation 

T» 


Gc(sl  wta) 
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(4-14) 


This  equation  may  also  be  written 
Cta)  _ 


Gc(a)  Wta) 
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Attention  la  now  directed  to  the  davaJopment  of  the  transfer  function 
Ge(s)  character  1 1 1 ng  the  controller.  Since  the  Input  to  each  channel  of 
the  controller  of  F|g.  4-2  which  computes  the  coefficients  ny,  k  ■  0,1,,.,  N, 
la  [e0<  t  J  •  ctt)]fc,  and  the  outputs  of  all  the  channels  are  summed  to  form 
mtt).  It  la  neceaaary  to  consider  only  the  nth  channel,  n  an  Integer,  such 
that  0|  n#l(,  and  sum  the  trenafe*  functions  of  the  N  channels  to  obtain 
Bc(*|.  The  nth  channel  may  ba  represented  aa  In  Fig,  d-9. 

The  channel  of  Fig,  4-9  wilt  he  subdivided  Into  three  parts  for  pur¬ 
poses  of  cnalyalsi  M)  the  pre-mul tipi Isr,  (2!  the  Integrator,  sampler 
*nd  iero«ard«r  hold,  «nd  (3)  tha  post-mu. 1 ir:i<r. 

Let  fine  *(♦)  -  [c0ltl  -  cltfj*  be  the  Input  end  y„(tl  th*  output  of 
the  pre-multlpller  (Fig.  4-fl),  the  output  Is  glvsn  by 

y„|tl  -  K„tt>  *  fltl.  U-lfll 

Sines  multlpllcstio  In  the  time  domain  correeponde  to  convoluHo?)  In 
the  frequency  domain,  the  Laplace  transform  of  the  pre-mu  1 1 1 p ! J or  output 
y,(a»  la  determined  by  tha  relation  ||p,  p.  279], 
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which  I*  a  ("eel  constant,  0"  «  He  fflj,  and  0”a^,  *>’*  abscissas 

of  absolute  convergence  of  the  time  functions  *K)  anH  Kn(t),  respectively, 
Eq.  4-17  Indicates  the  basic  difficulty  associated  with  obtaining  the 
transfer  function  of  tha  controller.  The  presence  of  the  controller  In¬ 
put  E(s)  within  the  complex  convolution  of  Eq.  4-17  makes  obtaining  the 
transfer  function  Gc(sl  Impossible  In  the  general  case. 

The  combination  of  Integrator,  sampler,  and  zero-order  hold  Is  given 
In  Fig.  4-7  where  the  Inputs  and  outputs  of  esch  device  have  been  defined. 
As  pointed  out  In  5ectlon  4,1,  since  the  optimization  process  is  executed 
on  a  per  Interval  basis,  the  Integration  In  the  controller  channel  must 
be  reset  to  zero  et  the  end  of  a  given  control  interval  end  the  beginning 
of  live  following  Interval,  That  Is,  st  the  end  of  the  kth  control  Inter¬ 
val,  the  output  of  Ihe  Integrator  must  be 
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It  In  possible  to  view  this  process  of  reset  Integration  on  a  continuous 
Integration  beols  bnc«“se  the  sampler  le  synchronized  with  the  time-varying 
golms  Kn(tJ.  Thus,  If  the  output  of  the  integrf.it  Ion  process  at  any  time  t,. 
t  %  0  U 
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The  transfer  function  for  the  *ero-order  hold,  Truxal  [30,  p.  507],  la 
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Combi  ..I  ng  b'qs,  4-27  and  4-28  and  recalling  "  “T~  ^®r*  results 
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•hleh  simplifies  to 
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Eq.  4-30  represents  th®  transfer  function  of  th®  Integrator,  sampler,  and 
zero-order  hold  combination. 

The  post-multiplier  with  Its  Inputs  q„(t)  end  pn< t ) ,  and  Its  output 
mn(t)  Is  shown  In  Fig,  4-3.  By  definition  the  output  of  this  multiplier 

Is 

mf|(t)  «  pn(t)  •  qn(tl  „  (4-311 

Again,  since  multiplication  In  the  time  domain  corresponds  to  complex 
convolution  In  the  frequency  domain,  tha  Leplsce  transform  of  the  multi¬ 
plier  output  Is  expraesed  by 

Se2  +  J  cd 

Pn(s-wS  Qn(s)  dw  (4-32) 

C2  -  J  ® 

where  max  ir#1#  V ^  4-  0“^)  <  r,  o-Ba<  ca  <  or- 

In  which  cj  Is  a  rtsl  constant,  (T»  Re|>],  end  CT#1,  <T#2  ere  the 

•becIsMP  of  sbaolute  convergence  of  the  time  function*  pn( t !  and  qn(t), 
respectively,  [29,  p.  27}]( 

Iqe.  4-17,  4-30,  end  4-32  ere  the  three  basic  relatloie  for  deter¬ 
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of  the  controller.  The  Inherent  difficulties  In  obtaining  Gcts)  are 
brought  out  by  these  three  equations.  The  presence  of  complex  convolution 
In  Eqs,  4-17  end  4-3.2,  and  Infinite  sum  of  Eq.  4-30  render  solution  for 
the  general  case  Impossible  as  mentioned  earlier.  The  main  obstacle  to 
the  use  of  the  transfer  function  approach  for  this  class  of  adaptive  con¬ 
trols  appears  to  be  the  presence  of  the  pre-multiplier  having  Inputs  eltl 
end  Kn<tl  This  multiplication  operation  forces  the  Laplace  transform 
of  the  Input  variable,  Els),  to  appear  under  a  complex  convolution. 

The  results  developed  In  this  section  wilt  be  modified  slightly  in 
the  next  section  and  applied  to  a  stability  analysis  of  a  particular 
•ub-claas  of  the  class  of  adaptive  controls  under  Investigation  In  this 
research. 

The  work  of  this  section  Is  summarized  in  the  block  diagram  given 
In  Tig.  4-9. 

4.3  Some  Stability  Results 

In  some  adaptive  control  applications  It  may  be  possible  to  use 
only  one  channel  in  the  controller  end  still  get  satisfactory  perform¬ 
ance.  For  thia  sub-elaaa  of  predictive  adaptive  controls.  In  which  a 
ono-tarm  approximation  of  the  control  variable  mtt)  la  employed.  It  la 
possible  to  utilize  the  results  of  the  preceding  section  to  effect  an 
analytical  stability  analysis. 

The  basic  block  diagram  for  ths  system  using  s  one-term  approxima¬ 
tion  of  the  control  variable  is  shown  In  Fig.  4-10.  From  Appendix  A  the 
external  Input  to  the  post-mu  I tl pi  I er  is 
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for  at  I  t.  Hence,  th»  poat-mul tipi ler  la  rap  laced  by  a  gain  of  VF- 


From  Eq.  4-9 
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where  all  of  the  symbols  have  been  defined  prevloualy. 

The  analysis  which  follows  Is  not  exact.  It  is  based  on  a  linear¬ 
ization  of  the  controller  In  order  to  determine  bounds  on  K0(t)  for 
stability.  The  time-varying  gain  Kg(t)  Is  replaced  by  a  constant  gain 
K0  end  the  reaultlng  system  is  analyzed  to  determine  the  range  of  values 
on  K0  for  which  the  closed  loop  system  is  stable.  KQ(t)  Is  then  con¬ 
strained  to  lie  within  this  range  for  each  control  Interval  0  «e  t  <  T. 
That  Is,  the  actual  range  on  K0< 1 1  Is  compared  with  the  required  range 
on  Kg  to  establish  raqulrements  on  the  system  parameters  end/or  the 
control  interval  length  for  closed-loop  sysfsm  stability. 

Utilizing  the  results  of  Section  4.2  and  tha  simpl Icatlons  discussed 
above,  and  replacing  the  Ideal  prediction  operation  eT*  by  tha  approxima¬ 
tion  1  +  Ts,  the  frequency  domain  block  diagram  becomes  that  shown  In 
fig.  4-11.  After  e  few  simple  block  diagram  manipulations.  Fig.  4-11 
reduces  to  Fig.  4-12. 

Since  the  system  employs  sampling,  use  of  tha  z-trensform  Instead 
of  complex  frequency  s  wi 1 1  fee! 1 1  tats  tha  analysis  considerably  and 
wllS,  therefore,  be  used  in  tha  work  which  follows.  Catting 
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Fig.  4-12 

Simplified  Block  Diagram  for  Stability  Analyals 
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Slock  Diagram  for  Stability  Anolyais  of  Example 
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It  Is  known  that  the  stability  [5ti,  Ch.  fi]]  of  the  configuration  of 
Fig.  4-12  !s  governed  y  the  locations  of  the  zeros  of  1  +  Gj  ( 2 ) , 
where  G^  Gj*2*  Is  the  z-transform  of  G^ls)  *  Gjlsf.  In  particular.  If 
the  zeros  of  1  +  G1  G2(z)  lie  within  the  unit  circle  of  the  complex  z- 
plane,  the  closed  loop  configuration  wilt  be  stable.  It  remains  then  to 
determine  the  conditions  on  1*0  In  order  that  the  zeros  of  1  +  G(  G2(zJ 
lie  within  the  unit  circle. 

The  exact  procedure  Is  bsst  clarified  by  a  specific  example. 

Example.  The  transfer  function  of  the  dynamic  process  is  assumed  to 
be  of  the  form 
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where  K  and  a  are  the  process  parameters.  It  Is  further  assumed  that  K 
and  a  are  both  positive  with  K  fixed,  but  a  variable,  Assuming  also 
that  system  error  is  weighted  uniformly  over  each  Interval,  that  Is, 
^IM  ■  X0  *  constant,  14-3'il 

♦  ne  time-varying  gain  KQC 1 1  Is  given  by 
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for  aach  Interval. 

For  this  example.  Fig,  4-12  assume*  the  form  given  In  Fig.  4  13. 
The  next  step  In  the  stability  analysis  Is  to  dstsrmine  th*  z-transi orm 
nf 


G| t s I  62(3) 


K 


n  - 


e“TV 


Ts  4  1 
Sis  +  oi 


14-41) 


Expanding  G^(s)  Gjlsl  In  a  partial  fraction  expansion  and  employing  a 
table  of  z- transforms  {30,,  p,  31  iQ  1°  identify  the  corresponding  z- 

trsnsforms  gives 
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Simplifying,  Eq,  4-42  yields 
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Adding  unity  to  Eq,  4-43  and  combining  terms  gives  the  result 
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Since  the  numerator  of  Eg.  4-44  Is  quadratic,  the  Schui -Cohn  test 
(30,  p.  92?]  will  be  utilized  to  determine  the  conditions  for  stability. 
Let  p(z)  be  the  numerator  polynomial  of  1  +  G^G^Iil,  The  Schur-Cohn 
test  then  requires! 

(1)  |p<Ol|  c^ 

<21  pit)  »  0 

(3)  p ( -1 > >  0 

where  the  coefficient  of  the  z2  term  of  pJzl  Is  unity.  For  this  exempt 

• .  4 

pUI  .  z2  +  ~i—  [irK<2oT  -  1  +  e"aT-  aTe"aTi|  z  -  -H~-  |eT  +  e“eT-  II 

•2-Tr,L  J  e2fP 

<4-491 


The  three  conditions  of  the  Schur-Cohn  test  are  now  examined 
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Cond it  Ion  ( 1 ) «  jpSOIj  <  1.  This  condition  becomes 
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Hence,  condition  Ml  may  be  written 
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The  actual  time- varying  gain  K0(t)  given  by  Eq.  4-40  la 
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which  la  always  positive.  This  gain  Is  a  simple  exponential  which  reaches 
Its  maximum  value  at  »  *  T. 
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Hence,  condition  (II  will  be  satisfied  If 
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Eq.  4-51  may  be  simplified  to  give 
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This  la  e  transcendental  Inequality  which  can  be  solved  to  determine  u 
condition  on  T  if  Xe  and  tha  bounds  on  a  and  K  ere  known.  A  specific 
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numerical  example  will  be  considered  after  the  other  two  condition®  hw.e 
been  examined. 

Condition  aucst  i  rut i ng  z  *>  1  into  Eq.  4-45  for  condition  (2»  give# 
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After  some  simplification,  Eq.  4-30  become* 

K0K  aT(1  -  e""1!  ♦  a2VT^<1  -  e_aT) >  0  .  (4-54) 

Sine#  1  -  a"aT  is  greater  than  zero  for  all  aT  greater  than  zero,  Eq.  4-54 
I*  solved  for  the  condition  on  XG  to  give 
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therefore,  since  K0(tl  as  given  by  Eq.  4-40  Is  always  positive,  the  second 
condition  of  the  Schur-Cohn  test  is  automatical  I y  satisfied. 

Condition  <31.  pl-1l>  0.  Substituting  *  »  -1  into  Eq.  4-45  and  applying 
condition  (31  gives  the  requirement 
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Eq.  4-56  can  be  simplified  to  fhe  inequality 
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Aa  In  condition  (11,  this  condition  imposes  an  upper  bound  on  KQ(t)  In 
order  to  assure  stability.  Henca,  In  terms  of  tha  maximum  value  of  K0(t) 
Eq.  4-57  becomes 
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ww  i  r  c  ny  i.q,  into  I  hr-  form  of  a  trerstersdenfa  I  Inequality  yields 

)loK2(t  -  *  t3«T  -24  2e"°T- aTe"®1 »  <a3T(1  I-  e~”T),  (4-59) 

Thunij  fur  this  extwtple,  Eqa.  4-52  and  4-59  arv  the  two  inequalities 
which  must  be  satisfied  to  Insure  closed  loop  stability.  Given  bounds 
on  a  and  K,  and  the  value  of  \n.  It  is  necessary  to  determine  the  vatu* a 
of  T,  If  they  exist,  which  will  satisfy  these  two  I nequal . f lea. 

Assume  for  the  system  considered  here  that  \g  *2,  K  *  2,  and  a 
var I e  ’  between  2  and  B.  Since  £qs,  4-92  and  4-59  are  transcendental,  a 
range  of  values  of  T  which  will  satisfy  thee:  both  for  the  extreme  varia¬ 
tion*  of  a  must  be  fouiMt  by  trial  and  error.  Considering  first  the  value 
of  a  «  2,  it  is  found  after  a  meaner  of  trials  that  for 

T  -  0.4  (4-601 

Eqs.  4-32  end  4-99  ore 

Condition  (lit  4.13<4.S4  (4-61) 

Condition  13):  l.10<3.2  .  (4-62) 

It  was  found  that  for  T  <0.4,  the  two  conditions  ware  aleo  satisfied. 
Considering  next  the  other  extreme  value  of  a,  a  »  9,  It  was  found  that 
the  two  conditions  were  also  satisfied  for  T^0.4.  In  particular,  for 
T  ■  0.4,  the  two  conditions  were 

Condi  Mot.  (1)s  3. 79^213.3  (4-63) 

Condition  (21 z  17.2  <  204.8  .  (4-641 

Therefore,  the  closed-loop  system  will  be  stable  for  vorlations  of  a 
In  the  range  (2,  0]  If  a  control  interval  length  less  than  or  equal  to 
0.4  !s  used. 

It  should  be  pointed  out  that  the  results  obtained  above  are  con¬ 
servative.  By  constraining  T  to  be  test  than  some  specified  vat m,  K^lt) 
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has  twn  held  fo  the  range  of  values  for  which  the  poles  of  the  closed-loop 

KVKtem  ft  >  f>  within  th*»  unit  rlrrU  nf  ths  >.n{*na  Hn«rt»w»r_  alnra  th*»  ayatnm 

is  time-varying,  it  may  be  possible  for  the  system  to  be  stable  even  If 
KQltl  exceeds  the  bounds  Imposed  above.  In  terms  of  the  complex  plane, 
this  means  the  poles  of  the  system  may  move  outside  the  unit  circle  during 
e  portion  of  the  time  of  system  operation.  As  long  as  these  poles  do  not 
remain  outside  of  the  unit  circie,  however.  It  is  still  possible  for  the 
closed- I oop  system  to  be  stable. 

This  section  has  Indicated  a  method  for  analytical  stability  analysis 
of  the  sub-class  of  predictive  adaptive  controls  In  which  o  one-term  approx) 
motion  of  the  control  variable  Is  used.  It  is  clear  that  other  methods 
such  as  the  Nyquist  criterion  could  also  have  been  used,  and  the  presenta¬ 
tion  here  Is  by  no  means  exhaustive. 

For  the  general  ciaas  of  pred’ctive  adaptive  controls,  however,  no 
known  analytical  methods  of  stability  analysis  are  applicable.  The  diffi¬ 
culty  lies  primarily  In  the  fact  that  It  is  not  possible  to  obtain  a 
transfer  function  for  the  controller  portion  of  the  system.  Hence,  In  a 
particular  application  where  more  than  a  one- term  approximation  of  the 
control  variable  is  used,  analog  or  digital  computer  studies  may  be 
employed  to  study  stability  characteristics. 

4,4  Prediction  Accuracy  limitations 

Reference  to  the  optimum  control  configuration  of  Fig.  4-2  Indicates 
it  Is  necessary  to  conaidar  another  factor  In  addition  to  stability  to 
establish  the  control  interval  length.  This  second  factor  is  prediction 
accuracy. 

The  basic  function  of  the  controller  is  to  generate  tha  control  vari¬ 
able  by  operating  upon  an  estimate  of  future  system  error.  Hence,  the 
accuracy  of  this  estimate  is  a  primary  consideration  in  system  design. 
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While  the  subjects  of  prediction  end  prediction  accuracy  are  treated  In 
detail  In  Chapter  5,  the  salient  features  of  prediction  accuracy  will  be 

discussed  here  since  control  Interval  length  is  relates  to  prediction 

accuracy  as  well  as  to  stability  aa  shown  In  Sectir  4.3, 

For  purposes  of  Illustration,  only  a  functional  solution  of  the  pre¬ 
diction  accuracy  requirement  will  be  given  In  this  sactlon  with  the  details 
left  to  Chapter  5.  Consider  the  predictor  In  Fig.  4-14  which  haa  an  Input 

x<tl,  an  actual  output  yltl,  and  the  desired  output  xlt  +  T),  where  T  Is 

the  prediction  Interval  length.  The  Instantaneous  error  In  prediction  is 
defined  by 

Spf  1 1  ■  xlt  +  T1  -  yltl  .  14-MI 

The  mean-square  prediction  error  Is  then  given  by 

ep2lt»  "  jilt  +  T!  -  yltl]2  ( 4-66 ) 

where  the  bar  indicates  the  averaging  operation.  If  the  Input  signal 

xlt)  can  be  characteriz'd  by  a  finite  nunber  of  parameters  <  <*  ,  ...,  ), 

I  K 

R  an  Integer,  th*  output  signal  yltl  will  also  depend  upon  these  parameters, 
and.  In  addition,  upon  the  rat  of  parameters  . ..,  ^J^l,  0  an  Integer, 

characterizing  the  prediction  operation,  end  upon  the  prediction  Interval 
lengtn  T  {25,  p.  432],  Thus,  the  meen-squars  prediction  error  will  be 
sceie  function  of  these  same  quantities  and  wilt  ba  defined  by  soma  rela¬ 
tion 

•p  It)  *  M  ...,c4p,  ^i»  •••»  T)  <4-671 

Let  L  be  an  upper  bound  on  the  amount  of  mean-square  error  which  can  ba 

\  ' 

tolerated  In  the  predictor  output, 

«  2m  s;  l  . 
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Then,  from  Eq„  4-07,  the  prediction  eccurecy  requirement  becomes 

d|R,  p1#  pQ>  TJ  £  L.  14-691 

With  the  Input  signal  parameters  ( «f  ,  4  R)  and  the  predictor  para¬ 

meters  1  Pj,  ^  gl  known,  Eq.  4-09  represents  a  relation  with  one 
unknown  quantity  T.  If  this  relation  can  be  solved  to  find  values  of  T 
for  which  it  Is  satisfied.  It  Is  clear  this  solution  will  in  general  de¬ 
pend  upon  the  parameters  I0!  *  ...,  Ct  1,  (fl  ,  ,,,,  0  I  and  upon  L. 

l  R  *  1  '  y 

Usually  functions  of  the  form  given  in  Eq.  4-07  are  monotonic  non¬ 
decreasing  functions  of  T  for  signals  encountered  In  practice.  There¬ 
fore,  the  solution  of  Eq.  4-09  can  be  indicated  formally  by 

T  $  jl  ...,  *4  p,  ^  «  •«•/  I- 1  (4-701 

where  g  is  some  function  such  that 

f  . 01  r*  Pi*  •••'  Pq'  9t*i'  *••'  r'  Pr  •••'  Pq'  U]  ^  L 

(4-71 ) 

Eq.  4-70  places  an  upper  bound  on  the  control  interval  length  in 
order  to  satisfy  the  prediction  accuracy  requirement.  In  any  design 
problem  It  is  necessary  to  consider  both  stability  and  prediction  accu¬ 
racy  In  selecting  the  control  interval  length. 


CHAPTER  3 


PREDICTOR  AMO  CONTROLLER  DESIGN  CONSIDERATIONS 


This  chapter  presents  the  salient  features  of  the  predictor  end 
controller  designs  for  predictive  adaptive  controls.  Predictor  design 
Is  outlined  on  the  basis  of  the  classical  Wiener-Lee  (2fjj  theory  and 
llnjar  extrapolation.  Controller  design  is  presented  In  terms  of  the 
fundamental  controller  parameters  which  srei  (1)  the  system  error  weight¬ 
ing  factor  ^  f  1 1 #  (21  the  control  interval  length  T,  and  (3)  the  order  N 
of  the  polynomial  sum  approximation  of  ths  control  variabla  nit). 

3.1  Predictor  Design 

For  statiatlcel  input  signals  the  design  of  ths  predictors  needed 
for  the  class  of  adoptive  controls  devaloped  In  this  work  will  be  based 
on  the  clssslcal  Wiener-Lee  theory. 

Since  Wiener-Lee  prediction  theory  leads  to  the  dasign  of  linear 
predictors,  the  operations  of  pradiction  and  dlffcrsnca  commute  and  the 
predicted  error  signals  may  bt  written 

[c0(tl  -  cltl]  *  •  c0*Ct»  -  c*ftl  .  13-11 

Hence,  the  block  diagram  of  Fig.  4-2  may  be  redrawn  as  In  Fig.  3-1. 

In  order  to  effect  the  design  of  ths  predictors  in  tsnes  of  Wlensr- 

Lee  theory,  the  spectrel  densities  of  the  two  signals  to  be  predicted 

must  bs  known  a  priori .  In  any  practical  design  problem  Involving 

statistical  signals,  the  spectral  density  of  the  desired  response  cQftl 

w!  1 1  be  known.  Let  It  bs  denoted  by  y.  P  Is).  However,  the  spectrel 
t  °o 

density  ti)cc(s)  of  ths  dynamic  procsss  raaponse  is  not  known  «  priori . 
Sines  eft)  is  the  controlled  variable  end  the  primary  function  of  con¬ 
trolling  It  is  to  make  the  difference  Jc0<ti  -  cltlj  as  omell  as  posslbls 
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Identification  Index  of 

Information  Performance 


Fig.  9-1 

Optimum  Control  Conf I  duration 


.over  •  Iona  Interval  of  time,  a  raaaonablt  first  assumption  on©  (ai 

Icc 


.(Sl  & 


(9-21 


This  assumption  will  permit  a  first  design  of  the  feedback  predictor  of 
the  adaptive  system.  Then,  as  experience  la  gained  with  the  system, 
normal  operating  records  may  be  employed  to  obtain  better  Information 
about  the  spectral  properties  of  the  dynamic  process  response  c(tl, 

[29,  Ch.  10]  and  re-design  of  the  feedback  predictor  may  then  be  based 
on  this  new  Information,  Of  course.  If  operating  records  of  the  dynamic 
procaes  to  be  controlled  are  available  a  priori,  these  should  ba  employed 
to  carry  out  the  first  design. 

A  review  of  the  design  of  Wiener-Lee  predictors  Is  given  In 
Appendix  c  with  all  uf  the  necessery  aquations.  Those  results  will  now 
toe  applied  to  obtain  the  design  of  the  predictors  to  bs  used  In  the 
experimental  work  of  Chapter  6* 

The  spectre  to  be  used  In  this  rtssarch  are  of  the  form 


*  b  +  s 

where  s  le  the  complex  variable  r  +  Jd,  By  spectral  factorization 


(si  * 


b  ♦  js  • 


Substituting  Iq.  9-4  Into  £q.  C-tfi  gives 


•  -Jv. 


t+Tlw 


which  when  evslueted  becomes 


2rree 


-bft+TI 


'It  +  T!  - 


t  >  -  T 
t  <  -  T  . 


<9-f5l 


68 


Substitution  of  Eq,  9-6  into  Eq.  C-19  yltlde 

h  u, — 4-  . . 

^  b  +  J*  J 


(9-7 » 


H  (9-01 

Hones,  th»  optimum  predictor  for  the  spectra  to  be  used  In  the  experi¬ 
mental  studies  Is  a  simple  attenuator. 

To  determine  how  prediction  error  varies  with  control  Interval 
length  T,  the  mean-square  prediction  error  will  also  be  evaluated  here 
utilising  the  results  given  In  Appendix  C. 

From  Eq.  5-6, 

y>*<tl  -  47T2  «2  •“2bt  t  >  0  ,  (5-0) 

Substituting  Eq.  9-0  Into  Eq.  c-21  gives  the  minimum  mean-square  predic¬ 
tion  error.  Thus, 


df2(t) 


dt 


•  2Wb2(1  -  s_2bT)  ,  (5-10) 

t 

Kq.  9-10  is  plotted  In  Fig.  5-2  to  show  the  variation  of  prediction  error 
with  control  Interval  length.  The  necessity  of  keeping  the  control 
Interval  length  sstal  I  Is  obvious. 

Eq.  5-10  will  now  bs  ussd  with  the  results  of  Section  4...  to  deter¬ 
mine  control  Interval  length  In  terms  of  prsdictlon  accuracy.  Assume  It 
Is  desired  that  the  mean-square  prediction  error  be  less  than  some  nuU>e« 
A.  This  condition  than  places  an  upper  bound  on  the  prediction  error 
which  Is  sxprssssd  by 

2tTs2l1  -  s-2bT)  A 


(5-11) 


Fla.  9-2 

Meen-equar«  Prediction  Error  ••  • 
Function  of  Control  Interval  Length 


-  7t> 


which  readily  simplified  to 


r2bT  >. 


Taking  the  natural  logarithm  of  both  sides  gives 


-2bT  2s  I 


n  j"l  -  — 

L  2TTa  J 


13-12) 


(3-13) 


2bT 


"f'm*]- 


C5-14) 


Assuming  the  signal  spectrun  parameters  a  and  b  are  known, the  condition 


on  th-i  control  interval  length  T  beewts 


*•*'”[’  '?f?]  - 


(3-13) 


3.2  extrapolation 

In  some  design  applications,  the  spectral  density  of  c0 < t )  may  not 
be  available  a  priori.  Moreover,  it  may  be  known  that  c0(t)  is  a  poly¬ 
nomial  type  signal.  In  such  cases,  extrapolation  may  be  used  to  obtain 
[c0m  -  cit)j#. 

Tm 

Since  an  ideal  lead  having  the  transfer  function  e  is  not  physi¬ 
cally  realizable.  It  Is  necessary  to  employ  an  approximation  to  this 
Ideal  lead.  If  the  control  interval  length  Is  kept  small  and  the  fre¬ 
quencies  of  the  signals  within  the  system  are  low  such  that  |Ts|<<l 
where  s  »  AT  +  J (li,  the  first  two  farms  of  the  expansion  Jsi,  p.  loo] 


eTB  -  1  + 


(Ts)n 

n«1 


(3-16) 


may  be  used  as  the  approximation. 

The  transfer  function  of  the  first  two  terms  of  Eq.  3-16  can  ba 
approximated  by  a  passive  Iced  network  such  as  shown  In  Fig.  3-3.  The 
actual  transfer  function  of  this  network  is 


Lead  Kvtwork  Approximation  of  Exfrapolator 


•  «  t » 


o#lt> 


m<  t) 


^%—»JExtrapol*s»' 


^Control  lar 


Dynamic 

Procaaa 


F*».  »-« 

Confroi  Coni’ {(jurat  tori  Employing  Extrapolation, 


-  n  - 


i  *  a  *  ^  ' 

- ■ - *  Q  11  ■- 

XU)  1  +T, 


T1  >  T2 


I5-T7) 


rt~ 

where  Ct  =  - — Y.  -  R,C.,  and  T,  *  s — C..  Since  the  d-c  gain 

R|  t  *  "  *■  H|  4*  1 

of  the  network  la  than  unity,  a  gain  of  must  be  Introducad  to 

compensate  for  the  attenuation.  If  T^>>  f2  l»  chosen,  £q.  9-17  become* 


approximately 

lill  «  ,  +  t  . 

X( •)  ^  1  *  V 

which  la  the  desired  transfer  function. 


(9-181 


When  the  network  of  Fig,  9-3  ia  used  in  She  over-all  system,  the 
control  conf iguratlon  assumes  the  form  depicted  in  Fig.  9-4. 

An  important  factor  to  consider  In  using  extrapolation  Is  the 
difficulty  which  arises  when  there  Is  appreciable  noise  present  in  the 
control  loop.  Eq,  9-1d  indicates  that  the  approximation  of  the  Ideal 
lead  produces  an  extrapolated  signal  comprised  of  the  original  signal 
plus  T  tlmas  the  first  derivative  of  the  original  signal.  The  presence 
of  the  dl  f  ferentfat  Icr.  will  always  worsen  the  noise  conditions  In  the 
system  end  may  even  cause  sitpilfler  saturation. 

The  use  of  extrepolstion  has  beer  presented  here  as  an  alternative 
to  Wiener-Lee  predictor  design.  The  purpose  of  thlu  section  hes  been 
to  give  a  .reatmer.t  of  the  predictor  design  In  terms  of  extrapolation, 
and  to  point  out  the  difficulty  essoe'eted  with  Its  rse.  For  the  experi¬ 
mental  Invest  I  gal  Iona  to  be  given  In  the  next  chapter.  It  will  be  assumed 
that  the  spectrum  of  Cottl  Is  known.  Hence,  extrapolation  will  not  ba 
Investigated  experimentally. 

3.3  Controller  Design 

With  tie  predictor  design  known,  the  basis  of  tha  synthesis  proce¬ 
dure  Is  clear  and  the  over-ell  system  assumes  ths  configuration  of 
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FI 9.  4-2.  However,  before  t'«s  synthesis  of  ihe  system  can  fci  completed, 

1 1' Til  n«c«*Mry  to  consider  the  »•  I  *c  *  1  >n  of  three  fundamental  per  oroe  tors 
of  th*  control lefV  Thaaa  parameters  arai 

1.  The  system  error  weighting  factor  X  ffK 

2.  Tha  control  interval  length  T, 

3.  Tha  order  N  of  tha  approximation  o?  tha  control  variable. 

Tha  purpose  of  this  section  ia  to  praaant  a  qua  1 1  tat  I va  and  quanti¬ 
tative  dlacuaalon  of  how  thaaa  paranatara  can  ha  wlaetd. 

System  Error  Wa  I  pitting  Factor.  Examination  of  tha  control  squat  Iona, 

Eq>.  4-9  -  4-11,  end  tha  optimum  control  configuration.  Fig.  4-2,  reveals 
that  the  choice  of  Xttl  la  somawhat  arbitrary.  Tha  only  quantitative 
raatr.ctlon,  which  waa  given  In  Section  2.3,  la  that  X  ft)  >  0. 

While  tha  dealgner  haa  aama  freedom  in  tha  choice  of  Xlfrl,  hla 
selection  should  be  govarrted  primarily  by  tha  alma  or  goals  of  control. 
1S«o  Sections  1.1  and  2.31.  For  example.  If  errors  occurring  near  the 
and  of  ««~h  control  Interval  ar*  more  Important  than  those  near  tha 
beginning  of  tha  interval,  then  \  It),  couCd  e sauna  the  forma 

A  It!  •  At"  15-191 

or 

>lt)-Beyt  15-201 

where  A,  8,  and  Y  era  positive  constants.  Linear  and  nonlinear  combi¬ 
ne!  Iona  of  Eqa.  3-19  and  9-20  are  also  possible.  Because  of  the  Infinity 
of  combinations  «4t I ch  exist  as  choices  of  Xlii*  only  one  will  be  selected 
for  use  in  th*  experimental  work  which  follows.  System  arror  will  be 
weighted  uniformly  over  each  control  Interval  by  taking 

Am  -  \Vt  (5-21  i 

d»f’  X0  is  a  constant.  Response  character  1st  lee  for  different  values 
of  X0  will  than  be  investigated. 


Control  iBttrwl  JLjtngfh,  Quant  I  tstiwe  determination  of  the  control  Interval 
!e«0th  T  Vo  i»  weed  In  to  particular  daslgn  application  h»a  been  praaantod 
ii.  -*twl  I  !h  $*i  *Se«u\  4.3  and  4,<9.  The  two  basic  contidtnilon:  used  In 
tha  analyse*  prewnted  wsr#  stability  and'  prediction  accuracy,  r aspeetlvely. 
A  third  factor  wftlch  depends  cn  parameter  drift  l»  discussed  hart. 

This  third  I  actor  which  cocas  to  baar  on  the  preplan*  of  selecting  tha 

4 

control  Interval  length  la  tha  drift  rat*  of  tha  procoat  persmeters. 

Since  tha  control  coaf f iclanta  era  generated  during  ona  Interval  for 
uk»  at  ttw>  bag Inning  of  and  throughout  the  succeeding  interval,  tha 
sampling  Instants  aro  actually  the  points  In  time  at  which  Adaptation 
occurs.  Nance,  tha  choice  of  T  govarns  tha  frequency  of  adaptation.  If 
tha  process  pirmattri  chsngs  considerably  during  a  control  interval,  it 
is  clear  tha  adaptation  which  occurred  at  the  beginning  of  that  Interval 
will  ba  inadequate  for  the  parse* ter  changes*  Deciding  hw<  much  p#ret» 

"••tar  drift  should  be  tolerated  during  a  yivan  control  Interval  is*  a*  in 
tit  case  of  chooalng  X  Itl,  somewhat  subjective.  However,  It  seas  reason¬ 
able  that  T  should  be  chosen  saw) I  enough’  so  that  psromatar  drift  Is  lass 
than  5%  par  control  Interval. 

Husbar  of  Toms  In  holyncelel  Approximations.  Tha  ot>tlwl action  procedure 
given  In  faction  4.1  provides  no  wean*  of  choosing  the  order  M  of  ths 
control  variable  approximation 

N 

*<ti  *  ^ 

I iitu 1 1 1  v# I y,  one  would  axpact  a  higher -order  dynamic  process  to  req: * re 
more  channels  In  tha  controller  than  would  a  tower-order  process* 

Actually,  Eg.  4-11  represents  sn  Infinite  series  and  tha  ojitlwiaa- 
tlon  of  Section  4.1  Is  valid  only  if  tha  aarlaa  Eg,  4-11  fcowsergqa  mfeso- 
lutaiy.  Thus*  the  question  of  sMmtiut*  convsrgsnce  Is  a  b«*)^  constdere- 
tUfi  In  the  design  of  tha  control  terv 
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The  answer  tc  the  question  of  oU»r <ute  convergence  of  the  series, 

Eq.  4»11,  fa  not  ut  all  obvious  for  tha  general  case  from  tha  control 
aquations 

Kkt tt  -  Xiti  \  pk«n  w<t,ri  «j r  i4-»» 

*0 

and 

mk  «  j  Kkftl  jc0IU  -  eft)]*  dt  « .1-101 

% 

for  h  »  0,  1,,  N.  The  problem  la  compounded  furthar  by  tha  Increaa- 

I ng  complexity  of  tha  polynomials  pkft)  for  Increasing  values  «f  k.  (See 
Appendix  A. I 

A  method  for  determining  an  approximate  value  of  tha  number  of 
control  tar  channels  naadad  To r  a  particular  control  application  wi 1 1  be 
presented  hare  and  Illustrated  with  examples.  Two  of  ft-  sa  examples 
will  b«  investigated  experimental ly.  Tha  objective  of  tha  method  la  to 
obtain  an  engineering  estimate  of  the  nvaber  of  farms  naadad  In  Eq.  4-11 
in  order  tc  achieve  adequate  control. 

Tha  method  lb  based  on  a  direct  application  of  Eqtc.  4-9  -  4-11  and 
the  lot  Sowing  esaumptionaj 

1.  Tha  dynamic  pr ocean  la  essuned  to  be  at  tha  ts 

characteristics  corresponding  to  tha  moat  u»  -wi 

configuration. 

2„  The  predicted  system  error,  jc0lt»  -  cftjj*,  h  warned  ft  be 
bounded  by  tome  number  A  during  the  control  interval. 

In  practice,  these  two  assumptions  correspond  to  s  stop  function  input 
of  desired  response  at  the  same  flats  that  th*  poles  of  the  dynamic 
process  transfer  function  ore  In  th#  right-half  plane  or  on  tha  Jab«s2ls. 
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In  applying  the  method,  the  coefficients  k  ■  0,  1,  N,  are 

evaluated  under  assumptions  1  nd  2,  and  the  series  Eq.  4-11  expanded  In 
a  power  series  in  t  to  examine  the  behavior  of  the  latter  series'  <  o- 
efficients.  Examples  for  a  first-order,  a  ascot  l-order.  and  *  third- 
order  dynamic  process  ere  presented  below. 

Example  3,1 

Consider  the  dynamic  procesa  characterised  by  the  differential 
equation 

~  o  aft)  eltl  »  K  mlt) 

where  K  is  a  conatant  and  0  <  alt)  ge  1.  The  procesa  la  on  the 
verge  of  Instability  when  aft)  »  0, 

Assuming  system  error  is  weighted  uniformly  over  each  control 
Interval  so  that  \ft)  •  \0*  •  constant,  and  employing  Eqs,  4-9 
and  4-10  for  k  ■  0,  1,  2,  3,  4  gives  the  first  five  coefficients! 


3 


mj  ■  0 
Rj  «  0 

m4  -  0 


Theee  results  Indicate  a  Imp  term  approximation  In  fq.  4-11 
should  be  sufficient  to  control  the  flrat-'«rder  process.  Expanding 
Eq,  4-11  gives 

l 

mUI  ■  f|  X0AKT  *  |  X0AKT  lt°  -  X  pAkt1 
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whers  the  two  toms  in  the  coefficient  of  t°  are  due  to  and  m^ , 
respectively.  These  two  terms  are  equal  in  magnitude  Indlceting 
that  is  ss  important  as  mQ  in  generating  the  control  signal.  In 

terms  of  clsssicsl  control  system  design,  however.  It  Is  known  that 
this  first-order  process  can  be  compensated  by  a  pure  gain  which  can 
be  provided  by  using  only  s  one-tern  approximation  of  the  control 
signal. 


Example  5.2 

Consider  the  second-order  dynamic  process  characterized  by  the 
differential  equation 

♦  a(t)  i£  +  4ct t)  ■  4mttl 
dt2  dt 


where  0  sE  alt)  8.  The  process  is  on  the  verge  of  Instability 
when  oltl  ■  0  which  corresponds  to  zsro  damping.  The  locus  of  the 
polee  of  the  transfer  function  of  the  process  is  given  In  Pig.  5-5. 

Again  assuming  uniform  weighting  of  syatem  error  and  employing 
Eqs.  4-9  end  4-10  under  assumptions  1  and  2  above  for  k  «  0,  1,  2, 
3,  4,  gives  the  first  five  coefficients} 
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Fig.  5-5 

Locus  of  Polos  of  Stcontf-orOor  Process 
os  o  Function  of  Process  Porsmotsr. 
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IIkmm  of  the  complexity  of  theat  ixprtufoni,  If  is  not 
possible  to  draw  any  conclusions  about  ths  behavior  of  coafficianta 
for  all  valuaa  of  T.  However,  bacausa  of  atability  and  prediction 
accuracy  requirements  aa  diacusaad  earlier,  only  tha  short ar  control 
In tar vat  lengths  ara  of  Intareat.  Therefore,  matting  tha  assumption 
T  <  <1,  tha  coafflcienta  ara  given  approximately  by  tha  expressions: 


-  80  - 


5 

2 

Observe  th  '  the  coefficients  mQ,  mt,  end  »2  *r*  of  ord#r  T  » 

5 

«MI 

•rftereas  the  coefficients  *3  end  u>t  ere  of  order  T2.  Since  the 
above  expressions  ere  valid  for  T<  <1*  it  Is  clear  the  m3  and  m4 
ere  significantly  less  than  the  first  three  coefficients. 

By  substituting  the  ebove  set  of  coefficients  Into  Ed*  <*H, 
expanding,  and  turning  the  coefficients  of  like  powers  of  t,  the 
power  aeries  expansion  for  sltl  based  on  e  five-tens  approximation 
Is  obtained.  It  is  than  possible  to  determine  the  contribution  of 
each  Mfc,  k  »  0,  1,  2,  3,  4  to  the  power  aeries  for  mltl.  The 
results  era  summer  1  zed  In  Table  3-1  where  the  contribution  of  each 
my.  to  eech  coefficient  of  tn,  n  ■  0,  1,  2,  3,  4  Is  med*  elver. 

Thus,  the  coefficient  of  t°  is  the  sum  of  the  forms  in  the  first 
coluan,  that  of  t1  the  aus  of  the  tense  in  the  second  column,  and 
ao  an. 

Since  T <  < 1,  observe  that  onty  the  top  three  terms  of  column 
1  are  significant  In  the  coefficient  of  t°,  the  top  two  terms  of 
column  2  are  significant  in  the  coefficient  of  t1,  and  only  the  top 
term  of  column  3  is  significant  In  the  coefficient  of  ta,  Observe 
also  thet  the  terms  In  the  fourth  and  fifth  columns  are  multiplied 
by  t3  end  t4,  respectively,  where  0  as  t  as-  T,  aid,  therefore,  their 
maximum  and  minimum  vatuae  are  of  order  T4,  whereas  the  Above  co¬ 
efficients  have  m«xi me  and  minima  a?  order  T^. 

These  results  Indicate  a  three-term  approximation,  N  ■  2,  In 
Eq.  4-11  wilt  give  adequate  control  for  this  second-order  process. 
However,  assumption  2  assumes  s  constant  predicted  error  end  does 
not  account  for  rapid  but  continuous  changes  In  predicted  error  In 
the  control  Interval.  Hence,  the  result  N  «  2  ie  s  conserve t I v* 
figure  end  it  la  to  be  expected  that  N  »  3,  l.e.,  four  channels  in 
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the  controller,  will  be  needed.  This  feet  wl!3  be  demonstrated 
experimental ly. 


£ sample  9.3 

Consider  the  third-order  d/nem'e  process  characterized  by  the 
differential  equation 


+  afttl  j  +  bt.'l  —  +  4*1  clt)  -  4mCt) 

dt  J  Ldt2  J 


where  0«r,a(t)^10  end  OaSbttlsKB.  The  process  Is  on  the  verge 
of  Instability  when  alt)  ■  bit)  ■  0.  The  movement  of  the  poles  of 
the  dynamic  process  trsnsfer  function  may  oe  assumed  as  In  Fig.  9-6. 

Assuming  X<t)  »  Xe  end  utilizing  Eqs.  4-9  and  4-11  under 
assumptions  1  and  2  for  k  «  0,  1,  2,  3,  4,  9  gives  the  first  six 
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Ao  for  th*  uucond-ordsr  cum,  thus*  «xpr«uutona  do  not  pornilfr  on* 
to  dr*M  *«y  cone  lost  on»  «K>»ut  th*  b*h*vlor  of  th*  coefficient*  if  or 
•  U  value*  of  thu  control  Interval  (anyth  T,  How*v*r,  for  the  tenter 
sampling  r#i,*s,  T  c<1,  the  obov*  expressions  simplify  to: 
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Observe  that  to*  tr.Q,  mg*  or*«  m3  nr*  ot  order  T  „ 

11 

whereas  m4  and  m*  are  of  order  T  -  Hence-  »l>fc  T<  the  firs! 

four  coefficients  are  significant*  The  contribution  of  each  m^, 

H  *•  0,  1,  2,  3,  4,  5  to  each  coefficient  of  the  power  series  of  mftJ 
is  giver.  In  Table  5-2. 

Arguing  as  in  the  ease  of  the  second-order  process,  c.tly  the  top 
four  tema  of  colimn  1  the  top  thr*o  tense  of  column  2,  the  top  two 
terns  of  column  3,  and  the  topmost  tens  of  column  4  ere  significant 
In  the  formation  ot  the  coefficients  of  the  powvf  scries  of  mitl  since 
T  c  <1.  Hence.  Table  5-2  gives  the  conservative  value  of  H  *  3,  i,e,, 
four  channels  in  the  controller.  Again,  because  of  assumption  2 
and  experience  with  the  second-order  case.  * t  is  to  be  expected  that 
five  channels  in  the  controller  «i!i  bt  needed  to  assure  adequate 
control,. 

It  must  be  emphasised  that  the  method  Illustrated  In  the  above  three 
examples  is  not  a  technique  for  determining  the  value  of  N  which  is  neces¬ 
sary  and  sufficient  to  insure  absolute  convergence  of  the  series  Eq.  4-11. 
Rather  it  is  a  method  by  which  it  is  possible  to  obtain  an  engineering 
estimate  of  the  number  of  channels  needed  in  the  controller  to  give  adequate 
control  of  a  given  dynamic  process. 
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CHAPTER  6 

F»»!*E!!TAL  STUSIcS 

The  function  of  the  present  chapter  i«  to  Investigate  exper Imental ly 
♦  ho  response  characteristics  of  sons  typical  control  systems  employing 
predictive  adaptive  control.  Various  aspects  of  prodlctlvo  adaptive  con¬ 
trol  systems'  behavior  are  presented  graphically  to  depict  certain  limi¬ 
tations  as  well  ss  advantages  of  this  clsss  of  controls. 

6.1  Outline  of  Procedure 

The  control  of  a  flrat-ordar  and  a  second-order  dynamic  process 
using  prsdlctive  adaptive  control  will  be  investigated  with  the  eld  of  an 
analog  computer.  The  exact  natura  of  the  process  parameter  variations 
will  be  given  es  each  system  Is  considered.  Also,  in  order  to  emphasize 
the  results  rather  then  the  details  of  the  slaw  1st  Ions,  the  circuitry 
necesaary  to  perform  ihe  operations  of  resat  Integration  and  sample-and- 
hois,  as  wall  sa  the  complete  analog  computer  diagrams,  will  be  given  In 
Appendix  0. 

Three  beaic  experiment*  are  performed  on  each  of  the  systems  to  evalu¬ 
ate  the  quality  of  predictive  adaptive  control  In  essentially  thrse  differ¬ 
ent  control  situations.  These  experiment  *  are  outlined  below  end  measure 
the  following  three  aspects  of  controls  ID  the  ability  of  the  adoptive 
system  to  maintain  the  output  at  s  predetermined  constant  levs!,  121  the 
quality  of  system  transient  response  for  ctzp  functions  of  desired 
response,  and  (Si  the  ability  of  tha  system  to  follow  statistical  sig¬ 
nals,  all  in  the  presence  of  extreme  variations  of  the  dyneele  process 
parameters. 

t.  The  firet  experiment  is  performed  by  making  the  desired  response 
c0(tl  a  constant  and  observing  the  deviation  of  the  output  cftl 
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?r~.  the  uwalivu  vfiuv  <«  mu  dynamic  process  peremeters  vary 

bat  wan  thalr  axtram*  valuta,  fhe  p*'  cant  deviation  of  the 

output  from  th*  desired  valua  Is  defined  by  tha  ralation 

extreme  valua  of  ett)  -  daalrad  valua  of  c.ttl 

daviatlon  - - -  - - - - . -  - —  x  100* 

daalrad  valua  of  cQ(f) 


and  places  a  measure  on  tha  ability  of  tha  system  to  copa  with 
process  parameter  variations  in  tha  steady-state.  This  typ«  of 
control  Is  Important  for  chamlcal  proeasaas  where  It  ia  daalrad 
to  maintain  tha  quality  of  output  products  constant  within 
praacrlbad  limits. 

2.  Tha  aacond  experiment  ia  parfcrmad  by  applying  a  atap  function 
of  daalrad  raaponaa  c0ft>  to  tha  system  and  evaluating  tha 
charactar  of  tha  tranalant  raaponaa  In  farms  of  risa  tlma  and 
par  cant  ovar shoot.  Since  process  parameters  vary  during  tha 
operations,  aach  teat  ia  parformsd  at  laaat  three  times  in 
ordar  to  obtain  an  overage  behavior. 

R!«*  t!n»  Is  defined  as  tha  total  aiapsad  time  from  tha 
application  of  tha  atap  to  the  tlma  at  which  tha  raaponaa 
firat  reaches  the  daalrad  lava).  Par  cent  overshoot  la  defined 
by  tha  relation 

maximum  valua  of  ett)  during  tranalant  -  desired  value  of  c0(tl 


*  overshoot » 


daalrad  value  of  ce(tl 


10.21 


These  two  quantities  measure  tha  ability  of  tha  controller 
to  drive  the  dynamic  process  from  one  equilibrium  state  to 
another  in  tha  presence  of  parameter  variations. 

3.  Tha  third  experiment  Is  performed  by  shaping  tha  output  of  a 
noise  generator  to  obtain  a  signal  with  a  known  spectrum  for 


x  100*. 


~  80  - 


c0!t».  Typical  response  records  or®  presented  »n  * b*r< I *r— *  —  zyzizr. 
response  for  a  statistical  Input  signal. 

As  mentioned  In  Chapter  5  It  will  be  assumed  that  system  error  Is  to 
be  weighted  uniformly  over  each  control  Interval  so  that  Xltl  -  X„, 

Xc  a  constant,  will  be  used  In  the  exporlmenta,  Reference  to  Eq.  4-9 
reveals  that  X0  will  then  be  a  scale  factor  In  each  of  the  time-varying 
gains.  Therefore,  various  valuas  of  X0  will  be  used  to  point  out  how 
the  response  characteristics  of  predictive  adeptlva  controls  dapand  upon 
this  factor  which  govarns  the  relative  weighting  of  system  error  with 
respect  to  control  effort  In  the  Index  of  performance,  Eq.  2-4. 

An  Important  consideration  In  the  design  of  pradlctlva  adaptive 
controls  is  the  control  Interval  length  T.  To  demonstrate  the  effects 
of  this  daalgn  pareaatar,  tha  data  of  axparlmanta  1  and  2  will  be  pre¬ 
sented  graphically  as  a  function  of  T.  Tha  arror  weighting  factor  XQ 
will  . hen  be  used  ee  e  parameter  In  the  presentation  of  these  date. 

Since  the  basic  work  of  this  research  deals  with  the  modlf Icetlon 
problem,  the  tdentlf (cation  portion  of  the  complete  system  Is  simulated 
using  a  model  of  the  process  from  which  tha  tlma-varylng  gains  ara 
derived.  A  block  diagram  la  glvsn  In  Fig.  0-1  to  show  tha  flow  of 
Information  In  tho  simulation  studies. 

0.2  first-order  Dynamic  Process 

The  first  ayetem  to  be  considered  Is  one  Involving  the  control  of  a 
dynamic  process  characterized  by  the  differential  aquation 

||  *  alt)  cl 1 1  -  mm.  (0-3) 

The  parameter  eft)  varies  between  1  end  O.t,  a  range  of  10  to  1,  In 
e  sawtooth  manner  at  a  frequency  of  0.08  cpa  as  shown  In  Fig.  0-2. 

Tho  predictor  is  designed  on  the  s*sumptloh  that  the  spectrum  of 
the  Input  c0ftl  la  of  the  form 
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giving  th*  predictor  Inputs*  ritpont* 

_T 

hpftl  -  *  *  5ft*  <6—91 

where  T  Is  the  control  fntorvsl  length  snO  jit)  Is  the  unit  impulse 
function.  A  spec t run  of  ths  tons  Eg.  6-4  Is  weed  in  th#  statistical 
signal  wsssurwssnts.  Moreover,  Loo  j^25,  Ch.  ej  teas  shown  that  •  Poisson 
squara  mw  with  on  svsrsgt  *oro  crossing  frequency  of  i  slso  has  s  spec- 
trim  of  th*  tons  Eq,  6-4.  A  Poisson  square  wave  is  defined  her#  as  a  wave¬ 
form  which  alter notes  between  two  values  E  c m2  -E  ot  event  points  which 
srs  statistically  Independent.  Tho  probability  cf  finding  n  evsnl  points 
In  m  interval  Is  given  by  the  Poisson  distribution  [«. ..  »3 . 

Thus,  the  step  functions  spptlsd  to  the  systww  esn  be  con# I  derod  «*  sag- 
meht#  of/  such  s  wove  Ions. 

Using  *  one- tern  approx Inst  ton  of  mlt), 

•It)  -  mpf t )  16-61 

o  o 

1113 

data  wars  obtained  for  control  Interval  lengths  T  ■  y„  — ,  j,  I  ssc., 
and  for  X#  “  2,  9,  4,  6.  Tho  results  for  hiss*  vsluss  for  th#  first 
two  experiments  s re  shown  In  Figs.  6-3,  6-4,  and  6-9. 

Sines  It  Is  possibls  to  compensate  the  first-order  process  with  a 
pur#  gain,  the  curves  of  Figs.  6-3  and  6-4  indicate  Improved  system  per¬ 
formance  with  Increasing  X0  ftyr  vsluss  of  control  Interval  length  T. 
However,  the  date  for  per  cent  overshoot  Is  not  ss  well-behaved  and  Indi¬ 
cates  tho  need  for  making  tho  control  Interval  length  less  than  -  esc.  to 
keop  the  overshoe t  f*»r  •  »;«p  Input  below  20%  a 

Th*  amount  of  deviation  In  the  output  with  e  constant  Input  is 
excessively  force  for  irhe  lovwr  values  sf  X  0  end  the  control  interval 
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5 

length*  above  sac,  Tho  reason  tor  this  woa  discussed  in  Section  5„3 
where  it  wo*  pointed  out  that  the  choice  of  control  Interval  length  5a 

A  ■ 

dependent  «««•;  the  psrsastsr  drift  i«tw„  ror  example,  reference  to 
Fig*  6-3  indicate*  that  tor  X  0  "  2  the  control  interval  length  most  be 
leas  than  0.5  sec.  In  order  that  toe  output  not  deviate  by  more  than 
20%,  Since  the  parameter  drift*  between  its  extrema  in  <5.2$  sec.  (Fig. 
f*~2H,  a  control  Interval  length  of  0.5  sec.  eorreapondw  to  letting  tha 

parameter  drift  89  between  adapts: lor,  point*,  to  keep  the  output  from 

v  1 

deviating  more  than  10)6,  however,  values  of  An  5m  4  «nd  T  ■sf?  ^  »ec. 
arc  necessary.  Value a  ol  T  ^  ~  **c.  correspond  to  *  parameter  drift 
teas  than  or  equal  to  49  per  control  interval. 

Exam) net  Ion  of  Flga.  6-3,  6-4,  and  6-5  reveal*  that  the  quality  of 
control  continually  Improve*  with  Increasing  X0  end  decreasing  T.  From 
a  theoretical  viewpoint  4lv,i*  la  gratifying,  but  from  a  practical  view¬ 
point  It  la  mlaleeding.  Arbitrarily  increasing  \Q,  which  la  a  factor 
In  the  time-varying  gain,  vill  cauae  saturation  at  the  Input  to  the 
dynamic  proceea.  Thus,  there  exists  a  practical  limitation  on  the 
value  of  X  0  which  will  depend  upon  tha  range  of  Input  value*  of  mitt 
for  which  the  dynamic  process  i«  linear. 

The  minimum  value  of  T  which  may  b«  used  5®  governed  by  the  accuracy 
of  the  component*  uaed  in  the  time-varying  gain  generator,  for  a  given 
value  a  of  the  parameter  ain,  the  llma-varyln^  gain  la  given  by 


act!  ■  AiL  (1  -  e",fi 
^  mfl' 

for  0a£tj4T.  Ualng  Tuylor'a  formula  with  Lagrange*  a  form  of 
remainder  032,  p.  11 4J,  Eq.  H-1  ia 
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where  Ojg  *1*  4S  t  jf  Tu  Simplifying  Eq.  6-0  given 
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where  R  is  the  remainder  term 

R  -  .  l^SL  t2  16-101 

21/T 

jy  5 

for  Oaf  'T'^c,  f  j®  T,  Since  e~"  end  r  ere  positive  in  the  Interval 
at  Interest,  the  magnitude  o'  the  remainder  term  Is  bounded  from  above  by 

•X, 


1*1 « 


svr 


T *. 


ie-m 


Note  from  Eqa,  6-9  end  6-10  that  only  the  remainder  term  depends 
on  the  process  persmeter  c.  Thus,  If  the  components  used  to  generate 
end  defect  Ktt!t)  are  Insensitive  to  this  remainder  term,  the  controller 
will  be  unable  to  detect  variations  in  the  dynamic  process  and  the 
adaptive  capability  will  be  lost?  An  upper  bound  on  the  per  cent 
accuracy  required  In  the  equipment  may  be  determined  by  taking  Hie 
ratio  of  the  maximum  value  of  | R |  and  the  maximum  value  of  the  first 
term  to  give 


f  accuracy  required*  ^  *  100*  , 

For  a  nominal  value  of  a  ■  0,5  and  T  »  sec.  Eq.  6-12  gives 

*  accuracy  required*  1.568  .  (6-13) 

Two  typical  e'ep  responses  for  the  f >nt~ordur  dynamic  process 
ere  gJven  In  Figs.  6-6  end  6-7  for  X0  *  2,  T  *  4  sec.,  *ind  Xn  **  6* 

T  ■  ~  sec.,  respectively.  The  desired  response  c  itl  one  the  para¬ 
meter  variation  alt  I  ere  also  I  nc I uoytL-  Fig.  6-6  shows  the  large 
deviations  which  occur  in  tl<e  response  as  e  result  of  parameter  varia¬ 
tion  In  the  steedy-et>'<te.  Fig.  6-7  Indicates  system  response  for  n 
number  of  ate»  changes  In  the  desired  response. 
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A  typical  systsm  response  for  a  statistical  signal  c0ltl  having  a 
spectrum  of  tha  form  Eq,  6-4  la  given  In  Fig.  6-8  for  XQ  **  6,  T  »  ^  sac. 
The  parameter  variations  sra  tha  sane  as  before.  Although  there  is  con¬ 
siderable  smoothing,  tha  ability  of  the  system  to  follow  rapid  variations 
In  the  desired  response  such  as  in  the  sample  of  Fig.  6-8  appears  good. 
Tha  actual  response  lags  the  desired  response  by  approximately  one  control 
Interval.  Larger  values  of  T  which  were  tried  yielded  poorer  response 
giving  store  smoothing  and  missing  the  sharper  peaks  In  tha  statistical 
signal. 

6.3  Second-order  Dynamic  Process 

The  second  system  Investigated  dat  with  <he  control  of  a  second- 
order  dynamic  process  whose  differential  equation  Is 
2 

2-4  +  a«t»  —  *  4c m  -  4»sn.  i6-u. 

d»z  dt 

The  parameter  eftl  is  assumed  t  vary  between  0  and  B  In  a  aewtc.rh 
manner  at  a  frequency  of  0.08  cps  as  shown  In  Fig,  6-9. 

The  predictor  la  designed  under  the  same  assumptions  as  for  the 
flr«'-or<Mr  dynamic  process  snd  Is  given  by  Eo.  6-9, 

The  results  of  Section  5.3  Indicate  s  four-term  approximation  of 


•m, 
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Is  needed  to  give  adequate  control.  Both  a  four-term  snd  a  three-, arm 
approximation  are  used  to  obteln  a  comparison  between  their  ebilltlee 
to  give  odequete  control.  Since  the  enslyais  of  Section  3.3  Is  valid 
for  the  shorter  control  Intervals,  If  Is  to  be  expected  that  neither 
approximation  wi 1 1  be  adequate  for  control  interval  lengths  greeter  then 
^  sec. 


-  102  - 


For  fh*  four-term  approximation  of  wit)  data  »*r#  obtained  for 

i  a  a  • 

^  "  5'  ?'  8'  ?  ®nd  *  4>  B i  10,  Th»  rtiulU  for  these  values 

4  ««•  4ha  &M-— .  A  A  -  I  W*  *  —  r*  im  —  -  .  - 

.  .-v  m  *  KM1W1MTU  111  ri^«.  WtU#  O’"1  M  ,  O**  I 

and  6-13.  Fig.  0-11  la  presented  to  lllustrata  more  clearly  ateady-state 
adaptab!  1 1  ty  for  T  “  §»  ^»  ®nd  §  aac, 

Flga.  6-10  and  6-1 1  claariy  indicat#  the  Improved  steady-state 
adaptability  for  dacraaalng  T  and  Increased  X  0„  The  adaptive  capability 
U,  however,  completely  lost  for  T  >  |  aec.  Thl*  la  attrlbutad  to  two 
factora.  Flrat,  aa  mentioned  above,  the  four-term  approximation  of  alt) 
la  valid  only  for  the  ahorter  control  Intarvala.  Second,  the  dynwnlc 
process  la  known  to  become  unstable  during  the  course  of  I ta  parameter 
variation.  Thus,  In  the  vicinity  of  thla  unatable  atete,  the  frequency 
of  edaptetlon  must  be  fast  ao  that  the  proceaa  balng  control  lad  haa  liaa 
time  to  man  I  fast  I  ta  inatabltity  before  correction  occurs.  Since  the 
parameter  drlfta  between  I ta  extrema  In  6.2!>  aec,  IFlg.  6-91  and  the  date 
of  Fig.  6-10  Indicate  the  control  Interval  muat  be  leaa  then  -  aec.  to 
keep  the  output  from  drifting  mora  then  20».  thla  maana  the  control  Inter¬ 
val  langth  muat  be  choaen  ao  that  parameter  drift  Is  less  then  or  equal 
to  0*  par  control  Interval. 

The  .ranslent  data  alao  Indicates  a  trend  toward  Incontrol lebl 1 1 ty 
for  T3b|  aac.  with  the  four-term  approxlmstf on.  Examination  of  the  rise 
time  data  of  Fig.  0-12  without  retaranca  to  the  per  cent  overshoot  data 
0“13  woul  lead  one  to  believe  that  transient  response  Improves 
with  Increasing  1,  However,  for  T)  |  aec.  only  the  system  employing 

«  e*n  considered  to  give  satisfactory  step  response  If  It  is 
dealr<  i  that  per  cent  overshoot  be  kept  below  20b.  In  feet.  Fig.  0-13 
clearly  denotes  a  rather  sharp  degradation  of  control  for  T>  ■  sec.  A 
comparison  of  Fig,  0-3  for  the  first-order  process  with  Fly.  0-13  for 


Control  Interval  Langth 


Fig.  6-12 

Rlaa  Tlat  for  Sacond-ordar  O^nMlc  Procaaa  for 
Four-farm  Approximation  of  Control  Varlabla. 


Control  Interval  Length 


rig.  6-13 

Per  Cent  Overshoot  tor  Soconj-order  Dynamic  Process 
for  Four-term  Approximation  of  Control  Variable. 
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the  second-order  process  points  out  th#  need  for  a  control  Interval  length 

I 

TjSL  -■  sec.  tor  satisfactory  friin»S*nt  rtn*r»nn*«i*  for  hr.*h  Th!: 

■y 

figure  amounts  to  lattlng  th*  parameter  drift  4%  between  adaptation  points 
fcr  th*  control  of  those  dynamic  processes. 

A  typical  step  response  for  on*  of  th*  better  behaved  systems  using 
e  four-term  approximation  of  m(t)  with  X  "8  and  f  »;  use.  to  control 
tha  second-order  process  la  shown  in  Fig.  6-14.  The  parameter  variation 
sit  I  Is  shown  to  Indicate  the  behavior  of  the  process  parameter  during  the 
transient. 

Th*  step  response  for  th*  earn*  system  using  the  same  value  of  X0  *  B, 
but  a  control  Interval  threa  times  as  long,  T  «*  ^  sec.,  la  given  In  Fig. 
6-19.  Th*  quality  of  Ih*  response  has  clearly  degenerated  as  a  result  of 
tripling  tha  ■n?trv*l  l»*5*h.  Not  only  lu  th*  per  cent  overshoot  large, 
but  the  ripple  In  the  output  after  th*  transient  has  subsided  It  of  the 
order  of  9*. 

A  typical  rsspons*  for  a  statistical  signal  having  *  spectrum  of 
th*  form  of  Eq.  6-4  Is  shown  In  Fig.  6-16  fcr  -  10  and  T  -  ^  sec. 

The  smoothing  Introduced  by  th*  second-order  process  Is  much  greater 
than  that  for  th*  first-order  process  and  tha  former  system  Is  only  ablt 
to  follow  tha  slower,  well-defined  variations  In  eft).  Evan  for  tha 
slower  variations  In  c0(tl,  tha  response  eft)  lag*  by  approx Imstsly  four 
control  Intervals. 

In  ordtr  to  show  the  Inadequacy  of  the  three-term  approximation  of 
m(t)  and  to  obtain  a  comparison  with  the  four-term  approx I mat  Inn,  experl - 
ments  1  and  2  were  repeated  for  the  second-order  css*  using  th*  three- 
term  approximation 

2 

mft)  *  ^  w^p^f  ’*• 
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rhe  data  jr*  abown  In  Tip*.  rt-17  »«r.d  k-ig  n-f**  y;c*  no*  3i};ln»u 

t'.r  7  ■  £  sec.  b»cau  <t  I  h«e  resulting  systems  war*  unstable.  Despite  the 
reasonable  b* savior  of  the  steady-state  adaptability  and  the  rise  time 
characterl sties,  the  lack  of  control  for  the  three-term  approximation  Is 
brought  out  clearly  by  the  per  cent  overshoot  characteristics.  Hone  of 
the  systems  Investigated  exhibits  a  per  cant  overshoot  for  a  step  input 
less  than  339.  In  most  cases  there  was  a  tendency  of  the  system  to  become 
unstable  for  transient  Inputs.  It  Is  clear  that  on  the  beats  of  transient 
response,  the  three-term  approximation  is  completely  Inadequate  even  for 
the  shortest  control  interval  length,  T  ■  y  sac.  A  comparison  of  the  per 
cent  overshoot  for  s  step  input  for  the  three-term  and  the  four-term 

approx  I mat  I  one  Is  given  In  Table  6-1  for  T  ■  ~  sec. 

9 

6,4  Summary  and  Conclusions 

A  ntsnbsr  of  response  characteristics  wars  found  to  be  common  to  the 
two  sysf*Ms  Investigated.  The  most  Important  of  these  Is  the  continued 
improvement  of  performance  wl th  decreasing  control  Intsrvsl  length.  This 
feature  was  anticipated  theoretically  and  found  to  bs  limited  In  practice 
by  the  Information  handling  capabilities  of  the  components  used  In  the 
time-varying  gain  generator  end  tha  controller. 

For  the  sawtooth  type  of  parameter  variations  used  it  Is  found  that 
adequate  control  of  both  processes  Is  realized  by  choosing  the  control 
Interval  length  T  such  that  the  process  parameter  drifts  by  no  more 
than  49  per  control  Interval. 

The  factor  Xa  governs  the  relative  weighting  of  system  error  and 
control  effort.  It  wee  found  that  staady-stat*  adaptability  Improves  with 
increasing  \0*  Hence,  as  X0  la  Increased,  the  controller  pieces  more 
emphasis  on  system  error  than  on  control  effort,  end  therefore,  has  Isas 
regard  for  the  problem  of  saturation. 


Par  Cant  Ovarahoot 
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Xo 

Thraa  Tarma 

Four  Tarma 

4 

41.5 

4.5 

6 

35 

11.23 

8 

43 

0.7 

lAfllt  6-1 

Comparlaon  of  Par  Cant  Ovarahoot  for 
Thraa  and  Four-farm  Approklmat Iona 
of  Control  Varlabia  for  Sacond-ordar 
Dynamic  Procaaa. 


rs  obtained  here  Indicate  the  method  presented  In  Section 
^•3  f or  esflmotlno  the  number  nt  t-n-»  i-  -.«*•  >  — 

~  ,,,  »i<|  |  g  )«  QUUNU,  f  n<e 

statement  that  the  method  U  valid  only  tor  the  faater  adaptation  fre¬ 
quencies  has  also  been  substantiated* 
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CHAPTER  7 

CONCLUSIONS  AND  RECODE NuATIONS 

7.1  Summary  of  Result* 

Thl*  wo rk  has  presented  the  development  and  investigation  of  a  new 
class  of  control  systems  termed  predictive  adaptive  controla.  The  develop¬ 
ment  was  based  on  th?  assumptions  of  prediction.  Interval  control,  and 
synthesis  of  the  control  variable  by  »  cum  of  ©rthonormal  polynomials  In 
t.  The  optimization  procedure  led  to  the  formation  of  a  family  of  control 
laws  from  which  the  synthesis  of  the  optlmien  controller  was  specified. 

It  was  shown  that  while  the  transfer  function  of  the  controller  could  not 
be  derived  In  practice,  a  quasl-l inear  model  of  the  controller  could  be 
used  to  obtain  a  semi -quant I tati ve  stability  analysis. 

Predictor  design  was  presented  In  terms  of  the  classical  wlener~Le* 
theory,  and  ralatlonahlpa  for  control  Intarvai  length  in  term*  of  predic¬ 
tion  accuracy  ware  developed.  Preliminary  controller  daalgn  was  considered 
from  the  viewpoint*  of  aytfeei  errjr  weighting  factor,  control  interval 
length,  and  the  number  of  terms  needed  in  the  orthonormal  polynomial  sum 
approximation  of  the  control  variable,  A  #iethod  for  obtaining  an  englnaer- 
Ing  estimate  of  tha  latter  quantity  was  developed  and  Illustrated  by  thret 
examples,  two  of  which  ware  Investigated  experiment #1 ly. 

Control  of  f I.  *r-order  and  eeco id-order  dynamic  procesaes  was  inves¬ 
tigated  on  an  snslog  canputer.  Three  basic  experiment*  which  evaluated 
the  stesdy-etete  edeptabMity,  transient  response,  end  tha  statistical 
a'gnel  response  of  tha  (wo  syatam*  in  the  presence  of  axtrame  parameter 
variations  ware  performed.  In  general,  ft  wee  found  that  all  three 
aspect*  of  performer  #  improved  with  decreasing  control  Interval  length, 
but  that  the  minimum  veiu#  o-  interval  length  which  could  be  used  was 
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limited  by  the  accuracy  of  tht  time-varying  gain  and  controller  circuitry. 
Improved  performance  which  could  be  obtained  by  Increasing  the  system 
-rrcr  i?o !  gh  f !  r.g  fort .y,~  r»<ia  llmilcu  by  fhe  useful  linear  range  of  the 
dynamic  process  input.  For  the  two  system*  Investigated  It  was  pointed 
out  that  the  control  Interval  length  should  be  chosen  sc  that  the  process 
parameters  do  not  drift  by  more  than  4%  per  Interval  in  order  to  assure 
adequate  control.  Theoretical  results  pointing  to  the  need  for  keeping 
the  control  Interval  length  short  to  preserve  stability,  prediction  accu¬ 
racy,  and  loaa  of  control  due  to  process  parameter  drift  were  substantiated 
by  the  simulation  results. 

Investigation  of  the  number  of  terms  needed  in  the  control  variable 
revealed  that  tha  four-term  approximation  was  adequate  for  control  of  a 
second-order  process  whereas  the  three-term  approximation  was  not.  This 
result  was  anticipated  by  tha  preliminary  design  of  the  controller. 

One  of  fhe  unique  features  of  the  class  of  adaptive  controls  present¬ 
ed  here  was  that  explicit  evaluotlon  of  the  Index  of  performance  In  order 
for  fhe  controller  to  effect  a  control  policy  was  not  necessary.  The 
SjrSt«u>  u<u  *.«/(  cAvtuie  e  hunting  procedure  to  perform  system  optimization. 
Instead,  the  optimization  was  performed  directly  by  generating  tlme- 
•■arylng  gains.  The  tlme-vsrylng  gaJn  circuitry  required  es  Its  Input 
fhe  unit  Impulse  response  of  the  dynamic  process  being  controlled.  This 
Information  must  bs  supplied  by  e  suitable  Identification  procedure. 

Hencsy  It  is  clear  that  the  decision  step  was  built  Into  ths  controller 
from  ths  optimization  of  the  index  of  performance  from  which  ths  control 
I aws  were  spec I f ! sd . 

7.2  Recommends t Ions 

A  number  of  Interesting  problsms  which  merit  further  research  have 
arisen  ss  a  result  of  this  work. 


1  ’ll  - 


The  Index  of  performance  tisc-d  to  develop  the  class  of  controls  In¬ 
vestigated  In  this  research  dealt  with  process  optimisation  over  the 
Immediate  future,  l.e,,  ihe  Interval  {o,tJ.  This  approach  may  possibly 
be  extended  to  include  en  opl Imliot Ion  over  the  entire  future  by  a  slight 
alteration  of  the  Index  of  performance.  The  new  Index  of  performance 
would  assume  the  form 
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for  n  »  0,  1,  ....  where  T  Is  the  control  Interval  length.  The  optimi¬ 
sation  would  then  deal  with  specifying  the  controller  to  generate  the 
control  coefficients  of 
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te*>0 

at  each  sampling  Instant,  T  ■  nT„  Control  la  atlll  executed  on  a  per 
Intervrl  oaala  but  the  coefficients  specified  at  eoch  sampling  or 
adaptat.lon  point  would  be  optimum  for  ell  time  In  the  future  Instead  of 
only  for  the  Immediate  future  £o,t],  One  of  the  problem*  associated 
with  thl*  new  fonxglutlon  Is  prediction  of  eystsm  error,  Jc0(t)  -  cltjj. 
Since  prediction  accuracy  usually  becomes  poorer  es  the  prediction  In¬ 
terval  Increases,  1 1  iwey  be  odvfseble  to  pises  on  arbitrary  weighting  on 
ths  prediction  operation  In  which  th«  distant  future  Is  weighted  less 
heavily  then  ths  immediate  future. 

Another  problem  worthy  of  consideration  la  ths  choice  of  the  class 
of  polynomials  used  In  the  control  variable  mff)  given  by  Eq.  3-16. 

The  Legendre  polynomial*  were  chosen  for  this  research  primarily  because 
they  ere  polynomial#  In  t ,  Therefore,  the  resulting  control  signal  was 
Itself  s  polynomial  l»  f  which  Is  a  common  type  of  driving  signal  for 
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rfvnjmi^  prscs="=.  To-  aloi  Isi  i cb i  signals,  of  course,  the  wet  j  random 
variables.  In  general,  there  exists  no  method  for  choosing  the  nerf I cu ! er 
class  of  polynomials  which  would  be  optimum.  In  some  prescribed  sense, 
for  a  given  application.  Some  work  has  been  done  by  Lee  [jssj  on  the  ayn- 
thesl  :  of  networks  In  terms  of  orthonormel  polynomials,  and  more  recently, 
some  new  results  In  the  representation  of  signals  have  been  presented  by 
Lerner  [34],  However,  very  little  effort  has  been  devoted  to  the  develop¬ 
ment  of  criteria  for  optimum  synthesis  of  signals  or  classes  of  signals 
especially  as  applied  In  control  systems. 

Ths  stability  analysis  given  In  Section  4.3  Is  rsstricted  to  systems 
employing  a  one-term  approximst I  on  of  the  control  variable.  Hence, 
further  work  Is  needed  to  determine  more  precisely  stability  requirements 
for  the  more  general  class  of  systems  which  uss  an  N-term  <N  »  t I  approxi¬ 
mation  of  the  control  variable. 

Finally,  a  comparison  of  the  class  of  adaptive  controls  developed 
here  with  equivalent  non-adaptlve  systems  would  be  desirable.  The  non- 
adeptive  system  could  be  designed  by  classical  methods  [5]  for  the  nomi¬ 
nal  values  of  the  dynamic  process  parameters,  and  the  response  character¬ 
istic#  of  the  resulting  systam  Investigated  for  the  extrema  of  ths  process 


parameters 
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for 


0^t<T  whara  tha  f  Irat  tlx  P^IM  ara 


P0«t>  -  1 


p^n  »  y  ♦  -  i 


P  (M  .  JL  t2  -  I  t  +  1 
2  t2  T 


p,(t»  -  t3  -  ^2  t2  +  ~  t  -  i 

3  r3  t5  T 


P  ln  .20  f4.1«t3  »f2  +  1 

4  f4  ,3  jZ  T 


»  (»»  _  2M  .3  «30  #4  ,  560  .3  210  f2  .  30  . 

P*  1 1 J  ■  -Tp  t  -  ™Jm  t  ♦  -f  t  ••  f  ♦  f 

T  T4  T3  T2  T 

Eqe.  A-5  ara  ploftad  In  Flg»,  A-i .  A-2,  and  A-3* 
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M*nc«,  subsff  tutlng  Eq.  4-4  Info  Eq.  B-2  yields 

-  JT  Xm  j”  ^  pkvn  wit,*' I  <sr J  2  dt  ♦  t 


C  B— 31 


for  k  -  0,  1,  N. 

Sine*  >  (t)>.  0  wa*  specified  In  Chapter  2,  the  first  term  of  Eq. 
has  Ihe  property 


^  Xfti  j  pk<r>  drj 


dt  ^  0 


(B-4) 


O  L  0 

Therefore,  the  right-hand  aide  of  Eq.  fl-3  la  always  greater  than 
t>ro  giving  the  result 


21. 

for  k  «  0,  1,  M  and  thereby  Insuring  a  minimum* 


IB-3) 
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APPPurwy  C 

SUMMARY  OF  WIENER-LEE  PREDICTION  THEORY  {25] 


Tha  prediction  problem  may  be  viewed  ee  e  linear  filtering  problem 
ea  shown  In  Fig.  C-1.  The  filter  la  characterized  by  it*  unit  Impulse 
reapono*  h(f),  end  haa  an  Input  xltl,  an  output  ylt),  and  a  dealred  out¬ 
put  i(t).  The  filter  h(t)  la  to  be  determined  so  that  the  mean-square 
difference  between  the  actual  output  ylt)  and  the  desired  output  zlti  la 
a  minimum.  In  term*  of  Fig.  C-1  the  problem  la  one  of  finding  a  physi¬ 
cally  realizable  filter  hltl  such  that 

— n -  •  minimus  tC-11 

£*(t) 

where  the  bar  denotes  an  averaging  over  all  t ime. 

It  haa  been  shown  that  there  exists  s  unique,  physically  realizable 

filter  h_ltl  which  will  render  “—5 - e  minimum  [2%  Ch.  ml.  Thle 

filter  is  determined  from  e  sole  1 1  on  of  the  Wlener-Hopf  equation 


0xx‘r  -  ri»  -ri  “  0x,‘r’  -  0  r»°  ««» 


rv-  $ 

-m  9 

where  T J  Is  the  eutocorrelst Ion  function  of  the  Input  alt),  and 


l'7'l  Is  the  erosscorre I et Ion  function  of  the  Input  xltl  end  the  de¬ 


sired  response  zftl.  These  two  functions  are  defined  by  the  re  I  at  1 1 


6„tri  <  lie  \  x(tl  x<t  ♦ 

’  T-W)  «T 

<6„<r.  -  11.  £  f 

T^aa  J_T 


n  dt 


<031 


xct  -  x  t  zftl  dt 
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Solution  of  Eq,  C-2  can  be  affected  readily  In  the  frequency  domain 
provided  ara  Fourier  transformable,  The  technique 

was  davalopad  by  Wiener  and  la  tarmad  spectrum  factorization  [25„  p.'  37d] , 
Tha  results  ara  summarized  below  where  appropriate  definitions  have  been 
given  to  each  of  tha  functions  used. 

Tha  complex  Fourier  transform  pair  la  defined  by 


F(al  « 


poo 

nr  1 


.-J”  at 


m,‘S 


+ao  e-j  Or  ^ 


Fla>eJlida  . 


HO  +J  ®" 


Hem,  let 


(|)xjtte)  ■  complex  Fourlar  transform  of  ^xxIT), 
$«***  "  cosiplax  Fourier  transform  of  0XZ*T’** 


Also,  1st 


■  any  factor  of  (^xs(s)  which  contains  all  tha  polaa 
and  zaroa  of  ^xxl(*i  which  lie  In  the  upper  half  of  the  complex  plane. 


^)xx(e)  *  the  remaining  factor  of  ^/xxl*i  which  contain*  all 
the  polee  and  zeros  of  cj)XNl*i  which  lie  in  the  lower  half  of  tha  complax 


Then,  the  Fourier  transform  Hoprla)  of  the  optlran  filter  h0lt) 
which  satisfies  Eq.  C-2  !«  given  by 


%♦<’*>  -  —4 -  \  #“j*t  ** 


EC— -7 1 
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wti ere 

'f'i  tl 


-•ne-s-Jv, 

v^-«+Jv, 


h*!l  ,j»t 

<X>"  (w) 

X  XX 


dw 


IC-81 


In  which  the  complex  variable  of  Integration  w  la  w  ■  u  +  jv  wl th  u  and  v 
the  independent  real  variables  [ 25,  p.  392], 

Thle  reeult  will  now  be  special  I zed  for  the  caee  of  pure  prediction. 
Turn  Prediction. 

Consider  the  situation  where  cltl,  which  le  the  signal  to  be  predicted* 
la  relatively  free  from  noise  contamination.  Then*  In  terme  of  the  nota¬ 
tion  of  fig.  C-1 

xlt)  -  cltl  IC-PI 

and  xft)  -  clt  +  TJ  »  c*m  CC-10J 

where  T  la  the  prediction  interval  length.  For  this  case 


0xxm  -  cltl  clt  +T|  IC-11)  t 

«*.  ■ 

•  ^cc'r* 

where  the  bar  denotes  the  averaging  operation  of  Eq.  C-3.  Hence* 

The  Input-dealred  output  crosseorreletlon  function  la 


<f>airi  -  citi  cit  ♦  r  *  it 
•0= c'T  +  T' 

where  the  her  denotes  the  evereglng  operation  of  Eq.  C-4. 
glveo 


(C-1 3) 

Thle  result 
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r* 

*  \  ?cc‘  T*  Tl  *"J‘r  0  r 
^0 


■  t 


J*T 


$«*•'  - 


IC-141 


Hence,  the  opHmu.it  Wiener  predictor  I*  given  by  the  rotation* 


_o 


y>tt  ti 


dt 


where 


Jo^i  Cwl 

— yss,  #J,W 

<wl 

-«  +  Iv  «ec 


dw 


♦Jv, 

>+Jv. 


l*  fwl  aJ<t  +  T,W  dw 
LCC,W*  *  **  * 


1C-1S) 


IC-181 


■  x;* 

Prediction  Errors. 

Bkmh  f’*e  on  tiro  adaptation  proceae  li  based  on  tho  prod  I  c  tod 
error  signal,  an  anatyeia  of  predict Ion  accuracy  la  a  paramount  consider¬ 
ation  in  tha  daalgn  of  pradlctlva  adaptive  controls.  Hanca  tha  aquations 
necasaary  to  determine  mean-aquere  prediction  accuracy  ara  reviewed  below. 

Lae  J29,  p.  42&J  hae  shown  that  tha  minimum  maen-aquara  error  for  tha 
optimum  Wiener  filter  given  in  Eqa,  C-7  end  C-8  la 


tft 


CC-171 


^1,; 

where  ^  (tl  la  given  by  Eq.  C-8  and  ^KK«0)  Is  tha  value  of  tha  auto¬ 
correlation  function  I  for  T  *  0.  For  purs  predict  I  on  with  pre¬ 

diction  Interval  length  T»  Eq.  C-1'.  become* 
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c*m 


mSn 


"^cc'o'  -3^  r^-T. 


dt 


fC-18) 


where  ^Ifr  +  Tl  Jb  flfven  by  Eq.  C-lfi  snd  (jj^tOi  I*  the  value  df  the  auto¬ 
correlation  function  ^CC(T )  for  T  •  0.  After  •  change  of  variable  In 
tha  aecortd  farm,,  gq,  c-13  beewaea 


T^Sflj  *  ^CCI0) 

min  I 


1 

StF 


1  ^2<t> 


dt 


It  haa  bean  »hown  j25,  p.  43<J  that 


<t> 


cc‘0»  J  f  <t 


5C-20I 


Hence,  aubatltutlng  Eq.  e-20  Into  Eq.  C-1S>  givaa 


4  3tt» 


i;  *•  I 


I  dt 


CC-21 I 


for  pure  prediction  where  ^Itl  la  given  by  Eq.  C~1fi  for  T  ■  0, 
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APPENDIX  0 

DESCRIPTION  OF  EXPERIMENTAL  APPARATUS 

The  results  presented  In  Chapter  6  were  obtained  using  the  Berkeley 
EASE  Model  1032  Analog  Computer  and  standard  simulation  techniques. 

The  operations  of  resetting  the  integrators  and  of  sampling  were  per¬ 
formed  with  relays.  Two  630  ohm  DPST  relays  which  were  driven  by  the 
translator  circuit  of  Fig.  D-1  were  used  to  drive  two  larger  relays  whose 
confects  were  used  for  resetting  and  sampling.  The  control  Interval 
length  wea  changed  by  varying  the  frequency  of  the  square  wave  input  to 
the  transistor  drive  circuit.  The  reset  operation  wes  then  achieved  by 
using  a  pair  of  relay  contacts  in  aarlea  with  a  1000  ohm  resistor  between 
grid  and  output  of  tha  integrator.  The  gain  of  the  reset  Integrator  shown 
la  tan.  This  la  needed  to  compensate  partially  for  the  ett^nuntion  In 
the  multipliers  alnca  the  output  of  each  multiplier  Is  0.01  times  the  pro¬ 
duct  of  the  two  Input  signals.  In  order  to  simplify  ths  computer  diagrams 
given  below,  reset  Integrators  will  be  shown  as  conventional  Integrators 
but  will  ba  marked  "reset". 

The  sample  end  hold  circuit  used  fa  shown  in  Fig,  D-3.  A  second 
pair  of  contacts  which  are  normally  closed  were  used  to  provide  proper 
sequencing  so  that  the  output  of  the  reset  Integrator  was  sampled  before 
the  Integrator  was  rasef.  The  Interconnection  of  relays  and  contacts  la 
shown  In  Fig.  D-4.  Because  Rj  la  enargized  first,  tha  sampling  circuit 
Is  closed  Just  as  R2  Is  energized.  The  pull-in  time  wMleh  R2  requires 
to  close  the  reset  contacts  la  long  enough  so  that  sampling  Is  complsted 
before  reset  occurs.  To  simplify  the  complete  simulation  diagrams  further, 
the  sample  end  hold  circuit  will  be  Indicated  by  e  block  where  it  la  under¬ 
stood  the  circuit  In  the  block  is  that  of  Fig.  0»3. 
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In  order  to  ovoid  exceeding  the  frequency  response  limits  of  the  re- 
leys,  the  systems  simulated  Mere  time  seeled  to  operate  «t  1/s  of  real 
time.  That  Is#  If  t  Is  real  time  end  V'  is  simulation  time,  the  relation 
between  the  two  time  scales  is  t  ■  £  • 

The  polynomial  generator  used  In  given  In  Tig.  0-9,  Since  the  first 
polynomial  p0(T' |  j*  «  constant.  It  is  supplied  M  the  first  channel  of 
the  controller  by  «  gain  adjustment. 

The  controller  for  the  first-order  dynamic  process  using  a  two-term 
approximation  of  the  control  variable  is  shown  In  Tig.  0-6,  The  one-term 
approximation  Is  obtained  by  breaking  the  upper  channel  et  the  Input  to 
the  summing  amplifier. 

The  complete  elmuletlon  diagram  for  control  of  the  firet-order  process 
Is  given  In  Fig.  0-7.  The  Identi f icatlon  operation  le  simulated  by  using 
e  model  Identical  to  fha  process.  The  parameter  of  the  model  and  the 
process  srs  driven  by  the  saais  source  with  the  output  of  the  model  as  the 
Input  to  the  time-varying  gain  generator.  The  controller,  given  In  Fig.  D-d , 
fa  Indicated  as  a  block  with  its  externa!  Inputs  -iokoIT|,  and 

-lOPffV'l.  As  mentioned  above,  the  extra  factors  of  10  are  needed  to 
compensate  for  multiplier  attenuation. 

The  time-varying  gain  generator  and  the  controller  for  the  second- 
order  dynamic  process  with  s  four-term  approximation  of  the  control  vari¬ 
able  are  given  In  Fig*.  D-6  and  M,  respectively.  A  model  of  the  dynwalc 
process  Is  agel®  used  to  simulate  Ideal If Icatlon. 

with  the  polynomial  generator,  tfan-vsryf ng  gain  generator  and  con¬ 
troller  indicated  by  blocks,  the  complete  second-order  system  assumes 
the  form  of  Fig,  D-10. 
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values  of  system  error. 

Two  applications  of  predictive  adaptive  control  are  investigated  cm 
an  analog  computer.  The  results  of  three  basic  experiments  which  evaluate 
the  steady-state  adaptability,  transient  response,  and  statistical  signal 
response  of  tha  two  systems  are  reported. 
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